[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260929 11:34:43.771889 14199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.221.254:37585
I20260929 11:34:43.773329 14199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260929 11:34:43.774418 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:34:43.793973 14205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:34:43.793949 14206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:34:43.793959 14208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:34:43.795249 14199 server_base.cc:1034] running on GCE node
I20260929 11:34:45.008519 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:34:45.008759 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:34:45.008991 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681685008970 us; error 0 us; skew 500 ppm
I20260929 11:34:45.009860 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:34:45.015465 14199 webserver.cc:460] Webserver started at http://127.13.221.254:46481/ using document root <none> and password file <none>
I20260929 11:34:45.016427 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:34:45.016659 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:34:45.017117 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:34:45.023739 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/master-0-root/instance:
uuid: "500061ca42c54940afa7bace10982c88"
format_stamp: "Formatted at 2026-09-29 11:34:45 on dist-test-slave-szp1"
I20260929 11:34:45.032135 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260929 11:34:45.037773 14214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.039129 14199 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260929 11:34:45.039541 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/master-0-root
uuid: "500061ca42c54940afa7bace10982c88"
format_stamp: "Formatted at 2026-09-29 11:34:45 on dist-test-slave-szp1"
I20260929 11:34:45.039914 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:34:45.082367 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:34:45.083979 14199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260929 11:34:45.084491 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:34:45.155963 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.254:37585
I20260929 11:34:45.156075 14265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.254:37585 every 8 connection(s)
I20260929 11:34:45.163383 14266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:45.188760 14266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88: Bootstrap starting.
I20260929 11:34:45.194703 14266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:45.196774 14266 log.cc:824] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88: Log is configured to *not* fsync() on all Append() calls
I20260929 11:34:45.201606 14266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88: No bootstrap required, opened a new log
I20260929 11:34:45.225309 14266 raft_consensus.cc:348] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500061ca42c54940afa7bace10982c88" member_type: VOTER }
I20260929 11:34:45.225878 14266 raft_consensus.cc:374] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:45.226204 14266 raft_consensus.cc:729] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 500061ca42c54940afa7bace10982c88, State: Initialized, Role: FOLLOWER
I20260929 11:34:45.227131 14266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500061ca42c54940afa7bace10982c88" member_type: VOTER }
I20260929 11:34:45.227669 14266 raft_consensus.cc:388] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 11:34:45.227977 14266 raft_consensus.cc:482] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 11:34:45.228345 14266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:45.232509 14266 raft_consensus.cc:504] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500061ca42c54940afa7bace10982c88" member_type: VOTER }
I20260929 11:34:45.233328 14266 leader_election.cc:302] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 500061ca42c54940afa7bace10982c88; no voters:
I20260929 11:34:45.235096 14266 leader_election.cc:288] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 11:34:45.235462 14269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:45.238185 14269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 1 LEADER]: Becoming Leader. State: Replica: 500061ca42c54940afa7bace10982c88, State: Running, Role: LEADER
I20260929 11:34:45.239240 14269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500061ca42c54940afa7bace10982c88" member_type: VOTER }
I20260929 11:34:45.240263 14266 sys_catalog.cc:564] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 11:34:45.249956 14270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "500061ca42c54940afa7bace10982c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500061ca42c54940afa7bace10982c88" member_type: VOTER } }
I20260929 11:34:45.250705 14270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [sys.catalog]: This master's current role is: LEADER
I20260929 11:34:45.250492 14271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 500061ca42c54940afa7bace10982c88. Latest consensus state: current_term: 1 leader_uuid: "500061ca42c54940afa7bace10982c88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500061ca42c54940afa7bace10982c88" member_type: VOTER } }
I20260929 11:34:45.251082 14271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [sys.catalog]: This master's current role is: LEADER
I20260929 11:34:45.254091 14278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 11:34:45.266053 14278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 11:34:45.273176 14199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260929 11:34:45.285107 14278 catalog_manager.cc:1347] Generated new cluster ID: 91f89e8dbea5458b88fdb06184ff427f
I20260929 11:34:45.285446 14278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 11:34:45.301510 14278 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 11:34:45.303471 14278 catalog_manager.cc:1504] Loading token signing keys...
I20260929 11:34:45.331279 14278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88: Generated new TSK 0
I20260929 11:34:45.332408 14278 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 11:34:45.341106 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:34:45.351394 14288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:34:45.354333 14289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:34:45.355741 14291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:34:45.358539 14199 server_base.cc:1034] running on GCE node
I20260929 11:34:45.359318 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:34:45.359629 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:34:45.359836 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681685359817 us; error 0 us; skew 500 ppm
I20260929 11:34:45.360579 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:34:45.365451 14199 webserver.cc:460] Webserver started at http://127.13.221.193:40447/ using document root <none> and password file <none>
I20260929 11:34:45.366053 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:34:45.366307 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:34:45.366609 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:34:45.367949 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-0-root/instance:
uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
format_stamp: "Formatted at 2026-09-29 11:34:45 on dist-test-slave-szp1"
I20260929 11:34:45.374217 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260929 11:34:45.379159 14296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.380293 14199 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260929 11:34:45.380735 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-0-root
uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
format_stamp: "Formatted at 2026-09-29 11:34:45 on dist-test-slave-szp1"
I20260929 11:34:45.381151 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:34:45.420231 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:34:45.422061 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:34:45.424988 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:34:45.429535 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:34:45.429812 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.430130 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:34:45.430302 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.534961 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.193:35349
I20260929 11:34:45.535055 14358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.193:35349 every 8 connection(s)
I20260929 11:34:45.542155 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:34:45.557466 14364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:34:45.559065 14363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:34:45.567955 14366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:34:45.568608 14199 server_base.cc:1034] running on GCE node
I20260929 11:34:45.569612 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:34:45.569900 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:34:45.570111 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681685570095 us; error 0 us; skew 500 ppm
I20260929 11:34:45.570730 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:34:45.578136 14199 webserver.cc:460] Webserver started at http://127.13.221.194:44261/ using document root <none> and password file <none>
I20260929 11:34:45.578848 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:34:45.579089 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:34:45.579391 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:34:45.580709 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-1-root/instance:
uuid: "097dfc79d5174f56924ea7a18ed0b84d"
format_stamp: "Formatted at 2026-09-29 11:34:45 on dist-test-slave-szp1"
I20260929 11:34:45.583078 14359 heartbeater.cc:347] Connected to a master server at 127.13.221.254:37585
I20260929 11:34:45.583562 14359 heartbeater.cc:464] Registering TS with master...
I20260929 11:34:45.584693 14359 heartbeater.cc:511] Master 127.13.221.254:37585 requested a full tablet report, sending...
I20260929 11:34:45.587586 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260929 11:34:45.588201 14231 ts_manager.cc:194] Registered new tserver with Master: a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349)
I20260929 11:34:45.591925 14231 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37512
I20260929 11:34:45.592949 14371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.594219 14199 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260929 11:34:45.594457 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-1-root
uuid: "097dfc79d5174f56924ea7a18ed0b84d"
format_stamp: "Formatted at 2026-09-29 11:34:45 on dist-test-slave-szp1"
I20260929 11:34:45.594684 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:34:45.623660 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:34:45.625126 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:34:45.627849 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:34:45.631414 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:34:45.631606 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.631891 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:34:45.632036 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.734104 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.194:35939
I20260929 11:34:45.734230 14433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.194:35939 every 8 connection(s)
I20260929 11:34:45.740988 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:34:45.749383 14437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:34:45.753656 14438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:34:45.757818 14434 heartbeater.cc:347] Connected to a master server at 127.13.221.254:37585
I20260929 11:34:45.758222 14434 heartbeater.cc:464] Registering TS with master...
I20260929 11:34:45.759096 14434 heartbeater.cc:511] Master 127.13.221.254:37585 requested a full tablet report, sending...
I20260929 11:34:45.761656 14231 ts_manager.cc:194] Registered new tserver with Master: 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:45.764096 14231 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37514
W20260929 11:34:45.764410 14441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:34:45.764837 14199 server_base.cc:1034] running on GCE node
I20260929 11:34:45.765996 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:34:45.766245 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:34:45.766435 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681685766422 us; error 0 us; skew 500 ppm
I20260929 11:34:45.767107 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:34:45.769970 14199 webserver.cc:460] Webserver started at http://127.13.221.195:37861/ using document root <none> and password file <none>
I20260929 11:34:45.770622 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:34:45.770877 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:34:45.771183 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:34:45.772706 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-2-root/instance:
uuid: "525a4a04e06142f78e43891977a383c6"
format_stamp: "Formatted at 2026-09-29 11:34:45 on dist-test-slave-szp1"
I20260929 11:34:45.778436 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260929 11:34:45.782624 14445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.783615 14199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260929 11:34:45.784030 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-2-root
uuid: "525a4a04e06142f78e43891977a383c6"
format_stamp: "Formatted at 2026-09-29 11:34:45 on dist-test-slave-szp1"
I20260929 11:34:45.784427 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790681683607964-14199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:34:45.797406 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:34:45.798689 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:34:45.800791 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:34:45.803648 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:34:45.803895 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.804144 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:34:45.804342 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:34:45.899485 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.195:42009
I20260929 11:34:45.900069 14507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.195:42009 every 8 connection(s)
I20260929 11:34:45.919196 14508 heartbeater.cc:347] Connected to a master server at 127.13.221.254:37585
I20260929 11:34:45.919601 14508 heartbeater.cc:464] Registering TS with master...
I20260929 11:34:45.920305 14508 heartbeater.cc:511] Master 127.13.221.254:37585 requested a full tablet report, sending...
I20260929 11:34:45.922443 14231 ts_manager.cc:194] Registered new tserver with Master: 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:45.923200 14199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015882889s
I20260929 11:34:45.924268 14231 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37524
I20260929 11:34:45.927016 14199 test_util.cc:268] Using random seed: -1848925106
I20260929 11:34:45.983783 14231 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37534:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 11:34:45.987769 14231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 11:34:46.103179 14324 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0448d5b15d4a9dad99a17f41370a3f (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260929 11:34:46.105347 14322 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd48a7ba55048e7ac69547ba6e5c0e7 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260929 11:34:46.105715 14321 tablet_service.cc:1467] Processing CreateTablet for tablet 2cbe706ebb9246b796a0bae50c449b92 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260929 11:34:46.107730 14320 tablet_service.cc:1467] Processing CreateTablet for tablet b912ab72f4fb47d8a229cf8da3d8a132 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260929 11:34:46.103114 14323 tablet_service.cc:1467] Processing CreateTablet for tablet 1729c996ec604d6ca7ada0f1469a02be (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260929 11:34:46.112290 14324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0448d5b15d4a9dad99a17f41370a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.121316 14323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1729c996ec604d6ca7ada0f1469a02be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.120007 14318 tablet_service.cc:1467] Processing CreateTablet for tablet ac01d714feec4ddb97745c82793c4009 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260929 11:34:46.118609 14319 tablet_service.cc:1467] Processing CreateTablet for tablet 3df73c02af49482f860c4e009d0a701a (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260929 11:34:46.123692 14319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3df73c02af49482f860c4e009d0a701a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.125933 14318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac01d714feec4ddb97745c82793c4009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.126392 14316 tablet_service.cc:1467] Processing CreateTablet for tablet 4e62a341d904422c8f1e073281f9c51e (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260929 11:34:46.124861 14317 tablet_service.cc:1467] Processing CreateTablet for tablet 7992bb78a4f14c8685a8f81bf15e1716 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260929 11:34:46.128499 14316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e62a341d904422c8f1e073281f9c51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.130285 14317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7992bb78a4f14c8685a8f81bf15e1716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.132746 14322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd48a7ba55048e7ac69547ba6e5c0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.135407 14320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b912ab72f4fb47d8a229cf8da3d8a132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.144861 14321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cbe706ebb9246b796a0bae50c449b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.175526 14399 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0448d5b15d4a9dad99a17f41370a3f (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260929 11:34:46.177791 14398 tablet_service.cc:1467] Processing CreateTablet for tablet 1729c996ec604d6ca7ada0f1469a02be (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260929 11:34:46.179530 14398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1729c996ec604d6ca7ada0f1469a02be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.181658 14399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0448d5b15d4a9dad99a17f41370a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.202078 14397 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd48a7ba55048e7ac69547ba6e5c0e7 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260929 11:34:46.203536 14397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd48a7ba55048e7ac69547ba6e5c0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.208564 14473 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0448d5b15d4a9dad99a17f41370a3f (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260929 11:34:46.209982 14473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c0448d5b15d4a9dad99a17f41370a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.209604 14471 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd48a7ba55048e7ac69547ba6e5c0e7 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260929 11:34:46.211148 14471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd48a7ba55048e7ac69547ba6e5c0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.225432 14472 tablet_service.cc:1467] Processing CreateTablet for tablet 1729c996ec604d6ca7ada0f1469a02be (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260929 11:34:46.231341 14470 tablet_service.cc:1467] Processing CreateTablet for tablet 2cbe706ebb9246b796a0bae50c449b92 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260929 11:34:46.238242 14396 tablet_service.cc:1467] Processing CreateTablet for tablet 2cbe706ebb9246b796a0bae50c449b92 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260929 11:34:46.225476 14467 tablet_service.cc:1467] Processing CreateTablet for tablet ac01d714feec4ddb97745c82793c4009 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260929 11:34:46.233285 14466 tablet_service.cc:1467] Processing CreateTablet for tablet 7992bb78a4f14c8685a8f81bf15e1716 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260929 11:34:46.247637 14395 tablet_service.cc:1467] Processing CreateTablet for tablet b912ab72f4fb47d8a229cf8da3d8a132 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260929 11:34:46.247534 14465 tablet_service.cc:1467] Processing CreateTablet for tablet 4e62a341d904422c8f1e073281f9c51e (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260929 11:34:46.245924 14469 tablet_service.cc:1467] Processing CreateTablet for tablet b912ab72f4fb47d8a229cf8da3d8a132 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260929 11:34:46.232046 14468 tablet_service.cc:1467] Processing CreateTablet for tablet 3df73c02af49482f860c4e009d0a701a (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260929 11:34:46.255299 14472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1729c996ec604d6ca7ada0f1469a02be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.259577 14467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac01d714feec4ddb97745c82793c4009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.263747 14395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b912ab72f4fb47d8a229cf8da3d8a132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.269268 14470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cbe706ebb9246b796a0bae50c449b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.272604 14393 tablet_service.cc:1467] Processing CreateTablet for tablet ac01d714feec4ddb97745c82793c4009 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260929 11:34:46.267182 14526 tablet_bootstrap.cc:492] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
I20260929 11:34:46.263588 14394 tablet_service.cc:1467] Processing CreateTablet for tablet 3df73c02af49482f860c4e009d0a701a (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260929 11:34:46.279928 14279 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:34:46.285163 14469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b912ab72f4fb47d8a229cf8da3d8a132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.288882 14468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3df73c02af49482f860c4e009d0a701a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.292956 14396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cbe706ebb9246b796a0bae50c449b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.297058 14392 tablet_service.cc:1467] Processing CreateTablet for tablet 7992bb78a4f14c8685a8f81bf15e1716 (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260929 11:34:46.300464 14466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7992bb78a4f14c8685a8f81bf15e1716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.309590 14394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3df73c02af49482f860c4e009d0a701a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.312441 14465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e62a341d904422c8f1e073281f9c51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.309636 14391 tablet_service.cc:1467] Processing CreateTablet for tablet 4e62a341d904422c8f1e073281f9c51e (DEFAULT_TABLE table=test-workload [id=c0f97aee8cad4f7e9f9696eb2f62172e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260929 11:34:46.313838 14392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7992bb78a4f14c8685a8f81bf15e1716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.315888 14393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac01d714feec4ddb97745c82793c4009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.319880 14391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e62a341d904422c8f1e073281f9c51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:34:46.377959 14526 tablet_bootstrap.cc:654] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.465794 14527 tablet_bootstrap.cc:492] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:46.496475 14528 tablet_bootstrap.cc:492] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:46.499423 14526 tablet_bootstrap.cc:492] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
I20260929 11:34:46.503401 14526 ts_tablet_manager.cc:1397] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.268s user 0.003s sys 0.039s
I20260929 11:34:46.506628 14528 tablet_bootstrap.cc:654] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.507006 14527 tablet_bootstrap.cc:654] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.512156 14526 raft_consensus.cc:348] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.513211 14526 raft_consensus.cc:374] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.513576 14526 raft_consensus.cc:729] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.514349 14526 consensus_queue.cc:260] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.520824 14528 tablet_bootstrap.cc:492] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:46.521494 14528 ts_tablet_manager.cc:1397] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.048s user 0.012s sys 0.004s
I20260929 11:34:46.526669 14528 raft_consensus.cc:348] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.527522 14527 tablet_bootstrap.cc:492] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:46.528626 14527 ts_tablet_manager.cc:1397] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.064s user 0.021s sys 0.007s
I20260929 11:34:46.527427 14528 raft_consensus.cc:374] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.529747 14359 heartbeater.cc:503] Master 127.13.221.254:37585 was elected leader, sending a full tablet report...
I20260929 11:34:46.529724 14528 raft_consensus.cc:729] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.530367 14526 ts_tablet_manager.cc:1428] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.023s user 0.017s sys 0.004s
I20260929 11:34:46.531296 14526 tablet_bootstrap.cc:492] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
I20260929 11:34:46.530756 14528 consensus_queue.cc:260] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.533545 14527 raft_consensus.cc:348] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.534535 14527 raft_consensus.cc:374] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.534808 14527 raft_consensus.cc:729] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.535485 14527 consensus_queue.cc:260] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.538199 14526 tablet_bootstrap.cc:654] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
W20260929 11:34:46.542356 14360 tablet.cc:2369] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 11:34:46.558504 14434 heartbeater.cc:503] Master 127.13.221.254:37585 was elected leader, sending a full tablet report...
I20260929 11:34:46.559154 14526 tablet_bootstrap.cc:492] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
I20260929 11:34:46.559605 14526 ts_tablet_manager.cc:1397] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.028s user 0.017s sys 0.008s
I20260929 11:34:46.562141 14536 raft_consensus.cc:482] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.566453 14526 raft_consensus.cc:348] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.567363 14526 raft_consensus.cc:374] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.566982 14536 raft_consensus.cc:504] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.567693 14526 raft_consensus.cc:729] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.567727 14528 ts_tablet_manager.cc:1428] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.046s user 0.014s sys 0.001s
I20260929 11:34:46.568554 14508 heartbeater.cc:503] Master 127.13.221.254:37585 was elected leader, sending a full tablet report...
I20260929 11:34:46.569329 14528 tablet_bootstrap.cc:492] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:46.568588 14526 consensus_queue.cc:260] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.577538 14526 ts_tablet_manager.cc:1428] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260929 11:34:46.578744 14526 tablet_bootstrap.cc:492] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
I20260929 11:34:46.579437 14536 leader_election.cc:288] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:46.581779 14527 ts_tablet_manager.cc:1428] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.053s user 0.027s sys 0.018s
I20260929 11:34:46.582734 14527 tablet_bootstrap.cc:492] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:46.583053 14528 tablet_bootstrap.cc:654] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.590250 14527 tablet_bootstrap.cc:654] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.598079 14526 tablet_bootstrap.cc:654] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.603246 14528 tablet_bootstrap.cc:492] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:46.603816 14528 ts_tablet_manager.cc:1397] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.012s
I20260929 11:34:46.607393 14528 raft_consensus.cc:348] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.608191 14528 raft_consensus.cc:374] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.608613 14528 raft_consensus.cc:729] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.609479 14528 consensus_queue.cc:260] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.611956 14528 ts_tablet_manager.cc:1428] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260929 11:34:46.616854 14527 tablet_bootstrap.cc:492] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:46.617357 14527 ts_tablet_manager.cc:1397] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.011s
I20260929 11:34:46.619951 14527 raft_consensus.cc:348] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.622634 14527 raft_consensus.cc:374] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.622923 14527 raft_consensus.cc:729] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.624953 14527 consensus_queue.cc:260] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.625473 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:46.627622 14527 ts_tablet_manager.cc:1428] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.010s user 0.002s sys 0.003s
I20260929 11:34:46.628136 14526 tablet_bootstrap.cc:492] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
W20260929 11:34:46.628055 14373 leader_election.cc:341] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:46.628633 14526 ts_tablet_manager.cc:1397] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.050s user 0.023s sys 0.003s
I20260929 11:34:46.628809 14528 tablet_bootstrap.cc:492] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:46.631299 14527 tablet_bootstrap.cc:492] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:46.637212 14526 raft_consensus.cc:348] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.637848 14526 raft_consensus.cc:374] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.638131 14526 raft_consensus.cc:729] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.638762 14526 consensus_queue.cc:260] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.641054 14528 tablet_bootstrap.cc:654] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.642814 14526 ts_tablet_manager.cc:1428] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260929 11:34:46.643769 14526 tablet_bootstrap.cc:492] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
I20260929 11:34:46.650211 14526 tablet_bootstrap.cc:654] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.651968 14534 raft_consensus.cc:482] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.654211 14528 tablet_bootstrap.cc:492] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:46.654757 14528 ts_tablet_manager.cc:1397] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.026s user 0.019s sys 0.001s
I20260929 11:34:46.656227 14527 tablet_bootstrap.cc:654] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.656009 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:46.652498 14534 raft_consensus.cc:504] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
W20260929 11:34:46.659665 14373 leader_election.cc:341] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:46.660231 14534 leader_election.cc:288] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:46.660117 14373 leader_election.cc:302] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d; no voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:34:46.662703 14534 raft_consensus.cc:2726] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:46.659309 14528 raft_consensus.cc:348] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.663058 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:46.663434 14528 raft_consensus.cc:374] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.663744 14528 raft_consensus.cc:729] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.664458 14528 consensus_queue.cc:260] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.666436 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
W20260929 11:34:46.668294 14373 leader_election.cc:341] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:34:46.669274 14373 leader_election.cc:341] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:46.669868 14373 leader_election.cc:302] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d; no voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:34:46.670917 14534 raft_consensus.cc:2726] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:46.671310 14528 ts_tablet_manager.cc:1428] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260929 11:34:46.672246 14528 tablet_bootstrap.cc:492] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:46.684494 14527 tablet_bootstrap.cc:492] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:46.685001 14527 ts_tablet_manager.cc:1397] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.054s user 0.022s sys 0.008s
I20260929 11:34:46.686081 14526 tablet_bootstrap.cc:492] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
I20260929 11:34:46.686527 14526 ts_tablet_manager.cc:1397] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.043s user 0.017s sys 0.006s
I20260929 11:34:46.686791 14528 tablet_bootstrap.cc:654] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.687784 14527 raft_consensus.cc:348] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.688583 14527 raft_consensus.cc:374] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.688910 14527 raft_consensus.cc:729] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.689572 14527 consensus_queue.cc:260] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.689708 14526 raft_consensus.cc:348] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.690651 14526 raft_consensus.cc:374] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.690950 14526 raft_consensus.cc:729] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.691601 14526 consensus_queue.cc:260] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.692199 14527 ts_tablet_manager.cc:1428] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260929 11:34:46.693158 14527 tablet_bootstrap.cc:492] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:46.696882 14534 raft_consensus.cc:482] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.697363 14534 raft_consensus.cc:504] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.699239 14534 leader_election.cc:288] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:46.700911 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:46.701710 14526 ts_tablet_manager.cc:1428] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.015s user 0.004s sys 0.005s
I20260929 11:34:46.702697 14526 tablet_bootstrap.cc:492] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
I20260929 11:34:46.703089 14527 tablet_bootstrap.cc:654] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.702838 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
W20260929 11:34:46.703924 14373 leader_election.cc:341] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:34:46.707967 14373 leader_election.cc:341] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:46.709838 14373 leader_election.cc:302] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d; no voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:34:46.710618 14534 raft_consensus.cc:2726] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:46.713929 14528 tablet_bootstrap.cc:492] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:46.714346 14528 ts_tablet_manager.cc:1397] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.013s
I20260929 11:34:46.714576 14526 tablet_bootstrap.cc:654] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.716296 14528 raft_consensus.cc:348] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.717175 14528 raft_consensus.cc:374] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.717483 14528 raft_consensus.cc:729] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.718170 14528 consensus_queue.cc:260] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.718736 14527 tablet_bootstrap.cc:492] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:46.719746 14527 ts_tablet_manager.cc:1397] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.014s
I20260929 11:34:46.721254 14528 ts_tablet_manager.cc:1428] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.007s user 0.002s sys 0.006s
I20260929 11:34:46.722177 14528 tablet_bootstrap.cc:492] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:46.722555 14527 raft_consensus.cc:348] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.723641 14527 raft_consensus.cc:374] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.723958 14527 raft_consensus.cc:729] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.724725 14527 consensus_queue.cc:260] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.729420 14528 tablet_bootstrap.cc:654] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.733891 14526 tablet_bootstrap.cc:492] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
I20260929 11:34:46.734323 14526 ts_tablet_manager.cc:1397] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.008s
I20260929 11:34:46.736941 14526 raft_consensus.cc:348] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.737676 14526 raft_consensus.cc:374] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.737957 14526 raft_consensus.cc:729] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.738664 14526 consensus_queue.cc:260] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.740056 14527 ts_tablet_manager.cc:1428] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260929 11:34:46.741209 14526 ts_tablet_manager.cc:1428] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260929 11:34:46.742148 14526 tablet_bootstrap.cc:492] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
I20260929 11:34:46.749868 14527 tablet_bootstrap.cc:492] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:46.750976 14528 tablet_bootstrap.cc:492] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:46.751437 14528 ts_tablet_manager.cc:1397] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.029s user 0.025s sys 0.000s
I20260929 11:34:46.754503 14526 tablet_bootstrap.cc:654] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.756942 14528 raft_consensus.cc:348] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.757927 14528 raft_consensus.cc:374] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.758423 14527 tablet_bootstrap.cc:654] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.758440 14528 raft_consensus.cc:729] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.760465 14528 consensus_queue.cc:260] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.765308 14528 ts_tablet_manager.cc:1428] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.014s user 0.009s sys 0.000s
I20260929 11:34:46.766307 14528 tablet_bootstrap.cc:492] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:46.766577 14526 tablet_bootstrap.cc:492] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
I20260929 11:34:46.767036 14526 ts_tablet_manager.cc:1397] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.000s
I20260929 11:34:46.769703 14526 raft_consensus.cc:348] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.770454 14526 raft_consensus.cc:374] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.770710 14526 raft_consensus.cc:729] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.771348 14526 consensus_queue.cc:260] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.775384 14526 ts_tablet_manager.cc:1428] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260929 11:34:46.776356 14526 tablet_bootstrap.cc:492] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
I20260929 11:34:46.778625 14527 tablet_bootstrap.cc:492] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:46.778847 14531 raft_consensus.cc:482] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.779083 14527 ts_tablet_manager.cc:1397] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.007s
I20260929 11:34:46.779299 14531 raft_consensus.cc:504] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.782614 14528 tablet_bootstrap.cc:654] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.785624 14531 leader_election.cc:288] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:46.798430 14526 tablet_bootstrap.cc:654] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.798712 14527 raft_consensus.cc:348] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.801800 14527 raft_consensus.cc:374] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.802211 14527 raft_consensus.cc:729] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.803118 14527 consensus_queue.cc:260] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.813021 14533 raft_consensus.cc:482] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.813421 14527 ts_tablet_manager.cc:1428] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.034s user 0.006s sys 0.006s
I20260929 11:34:46.815109 14527 tablet_bootstrap.cc:492] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:46.813709 14533 raft_consensus.cc:504] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.819746 14533 leader_election.cc:288] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:46.820236 14533 raft_consensus.cc:482] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.824360 14533 raft_consensus.cc:504] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.845299 14526 tablet_bootstrap.cc:492] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
I20260929 11:34:46.845788 14526 ts_tablet_manager.cc:1397] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.070s user 0.013s sys 0.006s
I20260929 11:34:46.854245 14534 raft_consensus.cc:482] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.855512 14534 raft_consensus.cc:504] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.857100 14533 leader_election.cc:288] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:46.858151 14534 leader_election.cc:288] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:46.858927 14527 tablet_bootstrap.cc:654] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:46.862114 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e62a341d904422c8f1e073281f9c51e" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:46.869242 14528 tablet_bootstrap.cc:492] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:46.869752 14528 ts_tablet_manager.cc:1397] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.104s user 0.029s sys 0.012s
I20260929 11:34:46.872756 14526 raft_consensus.cc:348] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
W20260929 11:34:46.875640 14373 leader_election.cc:341] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:46.874163 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e62a341d904422c8f1e073281f9c51e" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:46.876704 14526 raft_consensus.cc:374] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 11:34:46.879397 14373 leader_election.cc:341] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:46.877579 14526 raft_consensus.cc:729] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.882942 14526 consensus_queue.cc:260] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.880167 14373 leader_election.cc:302] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d; no voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:34:46.885134 14534 raft_consensus.cc:2726] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:46.886469 14531 raft_consensus.cc:482] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.889488 14531 raft_consensus.cc:504] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.895087 14533 raft_consensus.cc:482] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.895802 14533 raft_consensus.cc:504] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:46.931245 14533 leader_election.cc:288] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:46.935179 14531 leader_election.cc:288] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:46.936640 14531 raft_consensus.cc:482] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.939807 14526 ts_tablet_manager.cc:1428] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.094s user 0.012s sys 0.000s
I20260929 11:34:46.939656 14531 raft_consensus.cc:504] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.938582 14528 raft_consensus.cc:348] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.947219 14528 raft_consensus.cc:374] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.947505 14527 tablet_bootstrap.cc:492] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:46.947556 14528 raft_consensus.cc:729] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.948155 14527 ts_tablet_manager.cc:1397] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.134s user 0.014s sys 0.007s
I20260929 11:34:46.948442 14528 consensus_queue.cc:260] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.950438 14526 tablet_bootstrap.cc:492] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
I20260929 11:34:46.952243 14531 leader_election.cc:288] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:46.957010 14533 raft_consensus.cc:482] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.958408 14533 raft_consensus.cc:504] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.959671 14556 raft_consensus.cc:482] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.960561 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:46.954973 14527 raft_consensus.cc:348] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.960438 14556 raft_consensus.cc:504] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.961603 14483 raft_consensus.cc:2454] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:46.962433 14533 leader_election.cc:288] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:46.963280 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:46.964448 14482 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:46.962459 14527 raft_consensus.cc:374] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:46.965055 14481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:46.966511 14531 raft_consensus.cc:482] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:46.966199 14298 leader_election.cc:302] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:46.969031 14556 leader_election.cc:288] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:46.969097 14561 raft_consensus.cc:2781] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:46.969129 14298 leader_election.cc:302] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:46.966907 14527 raft_consensus.cc:729] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:46.970698 14561 raft_consensus.cc:482] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:46.973116 14528 ts_tablet_manager.cc:1428] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.103s user 0.011s sys 0.017s
I20260929 11:34:46.969969 14531 raft_consensus.cc:504] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.973248 14561 raft_consensus.cc:3037] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:46.970679 14481 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:46.973762 14527 consensus_queue.cc:260] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:46.982224 14531 leader_election.cc:288] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:46.983091 14528 tablet_bootstrap.cc:492] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:46.986613 14531 raft_consensus.cc:2781] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:46.986994 14531 raft_consensus.cc:482] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:46.988883 14531 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:46.999208 14527 ts_tablet_manager.cc:1428] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.051s user 0.007s sys 0.001s
I20260929 11:34:47.003337 14526 tablet_bootstrap.cc:654] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:47.003181 14481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:47.004101 14481 raft_consensus.cc:2454] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:47.013095 14406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.014494 14408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.011969 14298 leader_election.cc:302] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.012974 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.018325 14528 tablet_bootstrap.cc:654] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:47.017653 14562 raft_consensus.cc:2781] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:47.015822 14409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.017886 14298 leader_election.cc:302] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.015442 14527 tablet_bootstrap.cc:492] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:47.015913 14406 raft_consensus.cc:2454] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:47.016009 14408 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:47.018664 14407 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:47.019191 14562 raft_consensus.cc:482] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:47.019587 14409 raft_consensus.cc:2454] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:47.021760 14562 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.020120 14561 raft_consensus.cc:504] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:47.030505 14561 leader_election.cc:288] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Requested vote from peers 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:47.031072 14561 raft_consensus.cc:2781] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:47.031411 14561 raft_consensus.cc:482] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:47.031729 14561 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.038134 14409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:47.038759 14409 raft_consensus.cc:3037] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.044800 14481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:47.045774 14481 raft_consensus.cc:3037] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.046618 14561 raft_consensus.cc:504] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.053586 14528 tablet_bootstrap.cc:492] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:47.054308 14528 ts_tablet_manager.cc:1397] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.071s user 0.015s sys 0.012s
I20260929 11:34:47.054666 14527 tablet_bootstrap.cc:654] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:47.055855 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.056523 14334 raft_consensus.cc:2454] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 0.
I20260929 11:34:47.058729 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.055116 14531 raft_consensus.cc:504] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.060405 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.060882 14332 raft_consensus.cc:2379] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 525a4a04e06142f78e43891977a383c6 in current term 1: Already voted for candidate a8503b7fe7ae4d89b3497b3634d62f83 in this term.
I20260929 11:34:47.060568 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.063246 14334 raft_consensus.cc:2379] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 525a4a04e06142f78e43891977a383c6 in current term 1: Already voted for candidate a8503b7fe7ae4d89b3497b3634d62f83 in this term.
I20260929 11:34:47.064875 14531 leader_election.cc:288] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Requested vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:47.070371 14447 leader_election.cc:302] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.065618 14561 leader_election.cc:288] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Requested vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:47.066334 14408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.070703 14406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:47.067013 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.071060 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.073688 14406 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.074898 14408 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 0.
I20260929 11:34:47.074878 14409 raft_consensus.cc:2454] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.076740 14556 raft_consensus.cc:2781] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:47.073798 14405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.080121 14556 raft_consensus.cc:482] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:47.081774 14297 leader_election.cc:302] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.081928 14556 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.082239 14526 tablet_bootstrap.cc:492] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
I20260929 11:34:47.081960 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.080426 14404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:47.078979 14562 raft_consensus.cc:504] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.087216 14404 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.077340 14332 raft_consensus.cc:2454] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 0.
I20260929 11:34:47.089831 14405 raft_consensus.cc:2379] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 525a4a04e06142f78e43891977a383c6 in current term 1: Already voted for candidate a8503b7fe7ae4d89b3497b3634d62f83 in this term.
I20260929 11:34:47.085470 14561 raft_consensus.cc:2781] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.086107 14526 ts_tablet_manager.cc:1397] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.136s user 0.014s sys 0.002s
I20260929 11:34:47.087906 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:47.092381 14561 raft_consensus.cc:686] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:47.096148 14483 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.096907 14561 consensus_queue.cc:237] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:34:47.097826 14333 raft_consensus.cc:2379] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 525a4a04e06142f78e43891977a383c6 in current term 1: Already voted for candidate a8503b7fe7ae4d89b3497b3634d62f83 in this term.
I20260929 11:34:47.098006 14447 leader_election.cc:302] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.112187 14533 raft_consensus.cc:2781] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:47.112650 14533 raft_consensus.cc:482] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:47.112998 14533 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.122941 14405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
W20260929 11:34:47.123934 14446 leader_election.cc:341] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:47.121163 14531 raft_consensus.cc:482] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:47.123951 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:47.125450 14407 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.125036 14531 raft_consensus.cc:504] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.126592 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:47.127059 14562 leader_election.cc:288] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Requested vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:47.125749 14528 raft_consensus.cc:348] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.133255 14482 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.134809 14528 raft_consensus.cc:374] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:47.133301 14446 leader_election.cc:302] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6; no voters:
I20260929 11:34:47.138078 14528 raft_consensus.cc:729] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:47.138342 14480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:47.142412 14531 leader_election.cc:288] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:47.144331 14480 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.147310 14405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.146428 14526 raft_consensus.cc:348] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.148896 14526 raft_consensus.cc:374] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:47.149248 14526 raft_consensus.cc:729] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:47.150054 14526 consensus_queue.cc:260] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.148386 14479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:47.145197 14528 consensus_queue.cc:260] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.156903 14526 ts_tablet_manager.cc:1428] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.059s user 0.008s sys 0.000s
I20260929 11:34:47.157618 14526 tablet_bootstrap.cc:492] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83: Bootstrap starting.
W20260929 11:34:47.154207 14297 leader_election.cc:341] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:47.152602 14481 raft_consensus.cc:2454] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
W20260929 11:34:47.161273 14298 leader_election.cc:341] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:47.169224 14404 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.172098 14297 leader_election.cc:302] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.173115 14531 raft_consensus.cc:2781] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.173589 14531 raft_consensus.cc:686] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:47.172894 14556 raft_consensus.cc:504] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.171144 14483 raft_consensus.cc:2454] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.167469 14446 leader_election.cc:302] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 525a4a04e06142f78e43891977a383c6; no voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:34:47.175490 14527 tablet_bootstrap.cc:492] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:47.175061 14531 consensus_queue.cc:237] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.175872 14406 raft_consensus.cc:2454] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.178519 14527 ts_tablet_manager.cc:1397] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.166s user 0.012s sys 0.013s
I20260929 11:34:47.178552 14533 raft_consensus.cc:504] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.185611 14297 leader_election.cc:302] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.186790 14528 ts_tablet_manager.cc:1428] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.132s user 0.003s sys 0.015s
I20260929 11:34:47.187290 14446 leader_election.cc:302] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 525a4a04e06142f78e43891977a383c6; no voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83
W20260929 11:34:47.188786 14446 leader_election.cc:341] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:47.189659 14561 raft_consensus.cc:2781] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.189097 14556 leader_election.cc:288] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:47.196396 14561 raft_consensus.cc:686] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:47.198086 14528 tablet_bootstrap.cc:492] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:47.197962 14569 raft_consensus.cc:2726] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:47.196481 14407 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.201603 14570 raft_consensus.cc:2726] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:47.201306 14561 consensus_queue.cc:237] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.195888 14480 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.204229 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:47.204545 14533 leader_election.cc:288] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
W20260929 11:34:47.206715 14446 leader_election.cc:341] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:47.207616 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
W20260929 11:34:47.208564 14446 leader_election.cc:341] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:47.208341 14527 raft_consensus.cc:348] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.209648 14527 raft_consensus.cc:374] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:47.209985 14527 raft_consensus.cc:729] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:47.211414 14528 tablet_bootstrap.cc:654] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:47.211184 14527 consensus_queue.cc:260] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.213904 14527 ts_tablet_manager.cc:1428] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.032s user 0.008s sys 0.000s
I20260929 11:34:47.214912 14297 leader_election.cc:302] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.217965 14527 tablet_bootstrap.cc:492] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:47.219091 14562 raft_consensus.cc:2781] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.219735 14568 raft_consensus.cc:2741] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260929 11:34:47.221503 14562 raft_consensus.cc:686] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:47.223593 14526 tablet_bootstrap.cc:654] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:47.224720 14562 consensus_queue.cc:237] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.229521 14482 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.242223 14528 tablet_bootstrap.cc:492] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:47.242871 14528 ts_tablet_manager.cc:1397] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.008s
I20260929 11:34:47.247154 14528 raft_consensus.cc:348] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.247877 14528 raft_consensus.cc:374] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:47.248127 14528 raft_consensus.cc:729] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:47.248812 14528 consensus_queue.cc:260] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.251073 14528 ts_tablet_manager.cc:1428] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260929 11:34:47.252099 14229 catalog_manager.cc:5495] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:47.252333 14528 tablet_bootstrap.cc:492] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6: Bootstrap starting.
I20260929 11:34:47.259778 14298 leader_election.cc:302] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8503b7fe7ae4d89b3497b3634d62f83; no voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6
W20260929 11:34:47.260790 14298 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:42009, user_credentials={real_user=slave}} blocked reactor thread for 102482us
I20260929 11:34:47.261075 14528 tablet_bootstrap.cc:654] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:47.261178 14527 tablet_bootstrap.cc:654] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:47.262518 14561 raft_consensus.cc:2726] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:47.262481 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:47.269505 14333 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.263019 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:47.274467 14332 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.277078 14526 tablet_bootstrap.cc:492] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83: No bootstrap required, opened a new log
I20260929 11:34:47.277520 14526 ts_tablet_manager.cc:1397] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83: Time spent bootstrapping tablet: real 0.120s user 0.013s sys 0.010s
I20260929 11:34:47.278494 14568 raft_consensus.cc:482] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:47.279055 14568 raft_consensus.cc:504] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.281523 14568 leader_election.cc:288] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:47.282258 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.282943 14334 raft_consensus.cc:2454] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 0.
I20260929 11:34:47.283877 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.284922 14447 leader_election.cc:302] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.286458 14333 raft_consensus.cc:2454] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 1.
W20260929 11:34:47.286924 14446 leader_election.cc:341] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:34:47.288199 14447 leader_election.cc:302] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters: 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:34:47.288913 14527 tablet_bootstrap.cc:492] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:47.289144 14568 raft_consensus.cc:2781] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:47.289537 14568 raft_consensus.cc:482] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:47.290000 14568 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.291428 14526 raft_consensus.cc:348] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.292109 14526 raft_consensus.cc:374] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:47.292419 14526 raft_consensus.cc:729] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Initialized, Role: FOLLOWER
I20260929 11:34:47.293026 14526 consensus_queue.cc:260] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.295624 14526 ts_tablet_manager.cc:1428] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260929 11:34:47.295819 14569 raft_consensus.cc:2781] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.289510 14527 ts_tablet_manager.cc:1397] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.007s
I20260929 11:34:47.296852 14569 raft_consensus.cc:686] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Becoming Leader. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:47.297732 14569 consensus_queue.cc:237] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.300444 14528 tablet_bootstrap.cc:492] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6: No bootstrap required, opened a new log
I20260929 11:34:47.300873 14528 ts_tablet_manager.cc:1397] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.005s
I20260929 11:34:47.300848 14332 raft_consensus.cc:2454] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 1.
W20260929 11:34:47.304077 14279 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:34:47.306133 14447 leader_election.cc:302] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters: 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:34:47.308877 14533 raft_consensus.cc:2781] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.309419 14533 raft_consensus.cc:686] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Becoming Leader. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:47.309213 14527 raft_consensus.cc:348] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.310429 14527 raft_consensus.cc:374] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:47.310719 14527 raft_consensus.cc:729] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:47.310770 14533 consensus_queue.cc:237] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.311712 14568 raft_consensus.cc:504] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.315364 14528 raft_consensus.cc:348] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.316300 14528 raft_consensus.cc:374] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:47.317886 14568 leader_election.cc:288] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:47.318266 14528 raft_consensus.cc:729] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Initialized, Role: FOLLOWER
I20260929 11:34:47.318933 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:47.319152 14527 consensus_queue.cc:260] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.319600 14332 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.318946 14528 consensus_queue.cc:260] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.321084 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:47.321347 14528 ts_tablet_manager.cc:1428] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6: Time spent starting tablet: real 0.020s user 0.001s sys 0.005s
I20260929 11:34:47.323625 14527 ts_tablet_manager.cc:1428] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260929 11:34:47.321659 14407 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.324575 14527 tablet_bootstrap.cc:492] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d: Bootstrap starting.
I20260929 11:34:47.328470 14527 tablet_bootstrap.cc:654] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d: Neither blocks nor log segments found. Creating new log.
I20260929 11:34:47.332942 14332 raft_consensus.cc:2454] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 1.
I20260929 11:34:47.334038 14447 leader_election.cc:302] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.335294 14568 raft_consensus.cc:2781] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.335772 14568 raft_consensus.cc:686] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Becoming Leader. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:47.332067 14407 raft_consensus.cc:2454] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 1.
I20260929 11:34:47.336618 14568 consensus_queue.cc:237] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.348619 14230 catalog_manager.cc:5495] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:47.353912 14230 catalog_manager.cc:5495] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:47.357100 14230 catalog_manager.cc:5495] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:47.366041 14527 tablet_bootstrap.cc:492] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d: No bootstrap required, opened a new log
I20260929 11:34:47.366515 14527 ts_tablet_manager.cc:1397] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.007s
I20260929 11:34:47.369553 14527 raft_consensus.cc:348] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.370244 14527 raft_consensus.cc:374] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:34:47.370524 14527 raft_consensus.cc:729] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Initialized, Role: FOLLOWER
I20260929 11:34:47.371543 14527 consensus_queue.cc:260] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.371536 14227 catalog_manager.cc:5495] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 525a4a04e06142f78e43891977a383c6 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "525a4a04e06142f78e43891977a383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: HEALTHY } } }
I20260929 11:34:47.373708 14527 ts_tablet_manager.cc:1428] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260929 11:34:47.373414 14227 catalog_manager.cc:5495] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 525a4a04e06142f78e43891977a383c6 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "525a4a04e06142f78e43891977a383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: HEALTHY } } }
I20260929 11:34:47.375097 14227 catalog_manager.cc:5495] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 525a4a04e06142f78e43891977a383c6 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "525a4a04e06142f78e43891977a383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: HEALTHY } } }
I20260929 11:34:47.454173 14534 raft_consensus.cc:482] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:47.454662 14534 raft_consensus.cc:504] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.456866 14534 leader_election.cc:288] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:47.457734 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.457978 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:47.458547 14332 raft_consensus.cc:2379] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 097dfc79d5174f56924ea7a18ed0b84d in current term 1: Already voted for candidate 525a4a04e06142f78e43891977a383c6 in this term.
I20260929 11:34:47.459759 14373 leader_election.cc:302] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d; no voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:34:47.460460 14534 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.465405 14534 raft_consensus.cc:2726] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:47.492182 14534 raft_consensus.cc:482] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:47.492700 14534 raft_consensus.cc:504] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.494326 14534 leader_election.cc:288] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:47.495204 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.495426 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:47.496025 14332 raft_consensus.cc:2379] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 097dfc79d5174f56924ea7a18ed0b84d in current term 1: Already voted for candidate 525a4a04e06142f78e43891977a383c6 in this term.
I20260929 11:34:47.497072 14373 leader_election.cc:302] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d; no voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:34:47.497843 14534 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.502513 14534 raft_consensus.cc:2726] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:34:47.511453 14561 raft_consensus.cc:482] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:47.511986 14561 raft_consensus.cc:504] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.514591 14561 leader_election.cc:288] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:47.515328 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.515655 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6" is_pre_election: true
I20260929 11:34:47.515909 14407 raft_consensus.cc:2454] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:47.516311 14482 raft_consensus.cc:2454] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 0.
I20260929 11:34:47.516913 14297 leader_election.cc:302] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.517748 14561 raft_consensus.cc:2781] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:47.518113 14561 raft_consensus.cc:482] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:47.518450 14561 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.524912 14561 raft_consensus.cc:504] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.526852 14561 leader_election.cc:288] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Requested vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:47.527971 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:47.528193 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:47.528502 14482 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.528803 14407 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.533181 14482 raft_consensus.cc:2454] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.534179 14298 leader_election.cc:302] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.534847 14561 raft_consensus.cc:2781] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.535125 14407 raft_consensus.cc:2454] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 1.
I20260929 11:34:47.535266 14561 raft_consensus.cc:686] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:47.536094 14561 consensus_queue.cc:237] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.544917 14230 catalog_manager.cc:5495] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:47.548605 14561 consensus_queue.cc:1035] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.580590 14562 consensus_queue.cc:1035] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.657660 14562 consensus_queue.cc:1035] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.659376 14562 consensus_queue.cc:1035] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.670603 14561 consensus_queue.cc:1035] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.684136 14561 consensus_queue.cc:1035] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.694561 14568 consensus_queue.cc:1035] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.710255 14568 raft_consensus.cc:482] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:34:47.710759 14568 raft_consensus.cc:504] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.714227 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e62a341d904422c8f1e073281f9c51e" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d" is_pre_election: true
I20260929 11:34:47.714895 14407 raft_consensus.cc:2454] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 0.
I20260929 11:34:47.715289 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e62a341d904422c8f1e073281f9c51e" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" is_pre_election: true
I20260929 11:34:47.715873 14446 leader_election.cc:302] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6; no voters:
I20260929 11:34:47.716135 14568 leader_election.cc:288] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:47.716774 14568 raft_consensus.cc:2781] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:34:47.717147 14568 raft_consensus.cc:482] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:34:47.717468 14568 raft_consensus.cc:3037] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.720489 14533 consensus_queue.cc:1035] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.722144 14333 raft_consensus.cc:2454] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 0.
I20260929 11:34:47.724741 14568 raft_consensus.cc:504] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.728691 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e62a341d904422c8f1e073281f9c51e" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:47.729339 14332 raft_consensus.cc:3037] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.732750 14561 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:34:47.738323 14406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e62a341d904422c8f1e073281f9c51e" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:47.738955 14406 raft_consensus.cc:3037] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:34:47.741490 14332 raft_consensus.cc:2454] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 1.
I20260929 11:34:47.742573 14447 leader_election.cc:302] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:47.743309 14533 raft_consensus.cc:2781] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:34:47.743881 14533 raft_consensus.cc:686] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Becoming Leader. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:47.744940 14533 consensus_queue.cc:237] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:47.745987 14406 raft_consensus.cc:2454] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 1.
I20260929 11:34:47.738263 14568 leader_election.cc:288] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 1 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:47.757076 14562 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.779295 14230 catalog_manager.cc:5495] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 525a4a04e06142f78e43891977a383c6 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "525a4a04e06142f78e43891977a383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: HEALTHY } } }
I20260929 11:34:47.815610 14533 consensus_queue.cc:1035] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.823764 14533 consensus_queue.cc:1035] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.836606 14570 consensus_queue.cc:1035] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:47.845490 14569 consensus_queue.cc:1035] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:34:47.936079 14482 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
mode: GRACEFUL
new_leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
from {username='slave'} at 127.0.0.1:55746
I20260929 11:34:47.936836 14482 raft_consensus.cc:595] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Received request to transfer leadership to TS a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:34:47.942122 14482 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:55746
I20260929 11:34:47.942749 14482 raft_consensus.cc:595] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:34:47.948001 14482 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:55746
I20260929 11:34:47.948633 14482 raft_consensus.cc:595] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:34:47.964578 14333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:39452
I20260929 11:34:47.965135 14333 raft_consensus.cc:595] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:34:47.971050 14333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:39452
I20260929 11:34:47.971576 14333 raft_consensus.cc:595] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:34:48.051927 14562 consensus_queue.cc:1035] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:48.064855 14562 consensus_queue.cc:1035] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:48.203648 14569 consensus_queue.cc:1035] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:48.218677 14568 consensus_queue.cc:1035] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:34:48.225126 14533 raft_consensus.cc:979] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:34:48.225595 14568 raft_consensus.cc:1067] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:34:48.228518 14407 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56922
I20260929 11:34:48.229117 14407 raft_consensus.cc:482] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:34:48.229496 14407 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.243044 14407 raft_consensus.cc:504] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.244828 14407 leader_election.cc:288] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:48.245909 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:48.245872 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:48.246636 14333 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.254287 14333 raft_consensus.cc:2454] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:34:48.255429 14373 leader_election.cc:302] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:48.257716 14534 raft_consensus.cc:2781] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:34:48.258208 14534 raft_consensus.cc:686] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:34:48.258920 14561 raft_consensus.cc:979] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:34:48.259406 14562 raft_consensus.cc:1067] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:34:48.259037 14534 consensus_queue.cc:237] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.261391 14407 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56910
I20260929 11:34:48.262025 14407 raft_consensus.cc:482] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:34:48.262463 14407 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.269026 14482 raft_consensus.cc:3032] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:34:48.269469 14482 raft_consensus.cc:729] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:48.269667 14407 raft_consensus.cc:504] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.270371 14482 consensus_queue.cc:260] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.271761 14482 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.273205 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:48.273813 14333 raft_consensus.cc:3032] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:34:48.274144 14333 raft_consensus.cc:729] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:48.274557 14480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:48.275125 14480 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.274870 14333 consensus_queue.cc:260] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.276041 14333 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.277540 14230 catalog_manager.cc:5495] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 1 to 2, leader changed from 525a4a04e06142f78e43891977a383c6 (127.13.221.195) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 2 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:48.282481 14531 raft_consensus.cc:979] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:34:48.282835 14333 raft_consensus.cc:2454] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:34:48.282984 14531 raft_consensus.cc:1067] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:34:48.285938 14406 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56910
I20260929 11:34:48.287866 14407 leader_election.cc:288] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:48.293232 14480 raft_consensus.cc:2454] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:34:48.287810 14406 raft_consensus.cc:482] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:34:48.294533 14406 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.288241 14373 leader_election.cc:302] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:48.301532 14612 raft_consensus.cc:2781] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:34:48.302145 14612 raft_consensus.cc:686] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:34:48.302989 14612 consensus_queue.cc:237] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.307893 14406 raft_consensus.cc:504] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.310711 14406 leader_election.cc:288] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:48.311853 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:48.312940 14482 raft_consensus.cc:2454] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:34:48.312630 14480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:48.316318 14480 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.317263 14569 raft_consensus.cc:979] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6: : Instructing follower a8503b7fe7ae4d89b3497b3634d62f83 to start an election
I20260929 11:34:48.317667 14569 raft_consensus.cc:1067] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Signalling peer a8503b7fe7ae4d89b3497b3634d62f83 to start an election
I20260929 11:34:48.313311 14333 raft_consensus.cc:3032] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:34:48.318326 14333 raft_consensus.cc:729] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:48.320464 14332 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
from {username='slave'} at 127.0.0.1:39450
I20260929 11:34:48.321017 14332 raft_consensus.cc:482] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:34:48.321377 14332 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.321898 14230 catalog_manager.cc:5495] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 1 to 2, leader changed from a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 2 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:48.324880 14480 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:34:48.326004 14373 leader_election.cc:302] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6; no voters:
I20260929 11:34:48.328775 14612 raft_consensus.cc:2781] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:34:48.328969 14533 raft_consensus.cc:979] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:34:48.329421 14612 raft_consensus.cc:686] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:34:48.319590 14333 consensus_queue.cc:260] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.330276 14612 consensus_queue.cc:237] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.329434 14533 raft_consensus.cc:1067] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:34:48.335536 14407 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56922
I20260929 11:34:48.336297 14407 raft_consensus.cc:482] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:34:48.336802 14407 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.340859 14332 raft_consensus.cc:504] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.335564 14333 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.346304 14406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:48.346984 14406 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.349752 14407 raft_consensus.cc:504] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.352178 14332 leader_election.cc:288] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 2 election: Requested vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:48.358719 14406 raft_consensus.cc:2454] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 2.
I20260929 11:34:48.358867 14230 catalog_manager.cc:5495] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 1 to 2, leader changed from a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 2 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:48.360014 14297 leader_election.cc:302] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:48.360782 14480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:48.360948 14562 raft_consensus.cc:2781] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:34:48.361377 14480 raft_consensus.cc:3032] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:34:48.361601 14562 raft_consensus.cc:686] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:48.361718 14480 raft_consensus.cc:729] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:48.362462 14480 consensus_queue.cc:260] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.362462 14562 consensus_queue.cc:237] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.363709 14480 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.370368 14480 raft_consensus.cc:2454] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 2.
I20260929 11:34:48.371646 14333 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:34:48.374711 14407 leader_election.cc:288] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:34:48.374364 14227 catalog_manager.cc:5495] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 1 to 2, leader changed from 525a4a04e06142f78e43891977a383c6 (127.13.221.195) to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:48.375387 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:34:48.375957 14482 raft_consensus.cc:3032] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:34:48.376252 14482 raft_consensus.cc:729] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:48.376956 14482 consensus_queue.cc:260] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.380144 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:48.380811 14333 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.383323 14482 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:48.388178 14333 raft_consensus.cc:2454] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:34:48.388962 14332 raft_consensus.cc:1226] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Rejecting Update request from peer 525a4a04e06142f78e43891977a383c6 for earlier term 1. Current term is 2. Ops: []
I20260929 11:34:48.389277 14373 leader_election.cc:302] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:48.390100 14612 raft_consensus.cc:2781] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:34:48.390529 14612 raft_consensus.cc:686] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:34:48.391253 14612 consensus_queue.cc:237] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:48.395643 14482 raft_consensus.cc:2454] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:34:48.399370 14227 catalog_manager.cc:5495] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 1 to 2, leader changed from 525a4a04e06142f78e43891977a383c6 (127.13.221.195) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 2 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:34:48.711024 14332 raft_consensus.cc:1261] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.712297 14612 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:48.721551 14482 raft_consensus.cc:1261] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.723762 14482 raft_consensus.cc:1261] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.725201 14614 consensus_queue.cc:1035] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:48.726831 14614 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:48.737555 14332 raft_consensus.cc:1261] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.738986 14614 consensus_queue.cc:1035] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:48.743444 14480 raft_consensus.cc:1261] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.744771 14614 consensus_queue.cc:1035] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:48.755052 14407 raft_consensus.cc:1261] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Refusing update from remote peer a8503b7fe7ae4d89b3497b3634d62f83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.755319 14332 raft_consensus.cc:1261] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.756757 14562 consensus_queue.cc:1035] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:48.757351 14612 consensus_queue.cc:1035] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:48.767686 14480 raft_consensus.cc:1261] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Refusing update from remote peer a8503b7fe7ae4d89b3497b3634d62f83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.769171 14562 consensus_queue.cc:1035] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:34:48.797863 14480 raft_consensus.cc:1261] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.799134 14612 consensus_queue.cc:1035] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:48.809718 14332 raft_consensus.cc:1261] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:48.811075 14612 consensus_queue.cc:1035] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:51.004204 14199 auto_leader_rebalancer-test.cc:269] The leader distribution is
I20260929 11:34:51.005024 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:51.021620 14332 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
mode: GRACEFUL
new_leader_uuid: "525a4a04e06142f78e43891977a383c6"
from {username='slave'} at 127.0.0.1:38888
I20260929 11:34:51.022193 14332 raft_consensus.cc:595] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Received request to transfer leadership to TS 525a4a04e06142f78e43891977a383c6
I20260929 11:34:51.035369 14407 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
mode: GRACEFUL
new_leader_uuid: "525a4a04e06142f78e43891977a383c6"
from {username='slave'} at 127.0.0.1:42192
I20260929 11:34:51.035923 14407 raft_consensus.cc:595] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Received request to transfer leadership to TS 525a4a04e06142f78e43891977a383c6
I20260929 11:34:51.037101 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260929 11:34:51.037559 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:34:51.306464 14622 raft_consensus.cc:979] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83: : Instructing follower 525a4a04e06142f78e43891977a383c6 to start an election
I20260929 11:34:51.306979 14531 raft_consensus.cc:1067] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Signalling peer 525a4a04e06142f78e43891977a383c6 to start an election
I20260929 11:34:51.308372 14482 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
from {username='slave'} at 127.0.0.1:55740
I20260929 11:34:51.308844 14482 raft_consensus.cc:482] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:34:51.309132 14482 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:51.313414 14482 raft_consensus.cc:504] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:51.314877 14482 leader_election.cc:288] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 2 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:51.315871 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:51.315953 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:51.316442 14332 raft_consensus.cc:3032] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:34:51.316509 14407 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:51.316728 14332 raft_consensus.cc:729] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:34:51.317461 14332 consensus_queue.cc:260] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:51.318625 14332 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:34:51.322160 14407 raft_consensus.cc:2454] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 2.
I20260929 11:34:51.323230 14446 leader_election.cc:302] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6; no voters:
I20260929 11:34:51.323807 14332 raft_consensus.cc:2454] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 2.
I20260929 11:34:51.324047 14621 raft_consensus.cc:2781] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:34:51.325294 14621 raft_consensus.cc:686] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 2 LEADER]: Becoming Leader. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:51.325968 14621 consensus_queue.cc:237] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:51.338589 14230 catalog_manager.cc:5495] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 reported cstate change: term changed from 1 to 2, leader changed from a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193) to 525a4a04e06142f78e43891977a383c6 (127.13.221.195). New cstate: current_term: 2 leader_uuid: "525a4a04e06142f78e43891977a383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: HEALTHY } } }
I20260929 11:34:51.494139 14632 raft_consensus.cc:979] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d: : Instructing follower 525a4a04e06142f78e43891977a383c6 to start an election
I20260929 11:34:51.494916 14632 raft_consensus.cc:1067] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Signalling peer 525a4a04e06142f78e43891977a383c6 to start an election
I20260929 11:34:51.496487 14482 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
from {username='slave'} at 127.0.0.1:55736
I20260929 11:34:51.496917 14482 raft_consensus.cc:482] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:34:51.497169 14482 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:34:51.501396 14482 raft_consensus.cc:504] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:51.502775 14482 leader_election.cc:288] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 3 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:34:51.503685 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:34:51.503834 14407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:34:51.504207 14332 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:34:51.504415 14407 raft_consensus.cc:3032] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:34:51.504771 14407 raft_consensus.cc:729] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:34:51.505425 14407 consensus_queue.cc:260] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:51.506366 14407 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:34:51.508708 14332 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 3.
I20260929 11:34:51.509697 14447 leader_election.cc:302] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:34:51.510506 14621 raft_consensus.cc:2781] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:34:51.510908 14621 raft_consensus.cc:686] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 3 LEADER]: Becoming Leader. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:34:51.510921 14407 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 3.
I20260929 11:34:51.511797 14621 consensus_queue.cc:237] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:34:51.518111 14230 catalog_manager.cc:5495] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 reported cstate change: term changed from 2 to 3, leader changed from 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194) to 525a4a04e06142f78e43891977a383c6 (127.13.221.195). New cstate: current_term: 3 leader_uuid: "525a4a04e06142f78e43891977a383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: HEALTHY } } }
I20260929 11:34:51.712694 14332 raft_consensus.cc:1261] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Refusing update from remote peer 525a4a04e06142f78e43891977a383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:51.713930 14621 consensus_queue.cc:1035] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:51.723418 14407 raft_consensus.cc:1261] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Refusing update from remote peer 525a4a04e06142f78e43891977a383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:34:51.725206 14621 consensus_queue.cc:1035] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:34:51.957309 14407 raft_consensus.cc:1261] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Refusing update from remote peer 525a4a04e06142f78e43891977a383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:34:51.959115 14621 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:34:51.968636 14332 raft_consensus.cc:1261] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Refusing update from remote peer 525a4a04e06142f78e43891977a383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:34:51.970034 14626 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:34:52.038426 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:52.043429 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:34:52.043843 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:34:53.044669 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:53.049304 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:34:53.049736 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:34:54.050786 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:54.056363 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:34:54.056782 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:34:55.057611 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:55.062516 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:34:55.062935 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:34:56.063783 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:56.068884 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:34:56.069414 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:34:57.070266 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:57.074654 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:34:57.075026 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:34:58.075735 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:58.080075 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:34:58.080492 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:34:59.081321 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:34:59.086258 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:34:59.086604 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:00.087371 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:00.092254 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:00.092687 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:01.120687 14199 auto_leader_rebalancer-test.cc:288] The leader distribution is
I20260929 11:35:01.125780 14333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:39452
I20260929 11:35:01.126549 14333 raft_consensus.cc:595] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:35:01.132160 14482 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:55746
I20260929 11:35:01.132726 14482 raft_consensus.cc:595] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 2 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:35:01.137346 14333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:39452
I20260929 11:35:01.137915 14333 raft_consensus.cc:595] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:35:01.142640 14333 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:39452
I20260929 11:35:01.143299 14333 raft_consensus.cc:595] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:35:01.153299 14482 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
mode: GRACEFUL
new_leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:55746
I20260929 11:35:01.153829 14482 raft_consensus.cc:595] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 3 LEADER]: Received request to transfer leadership to TS 097dfc79d5174f56924ea7a18ed0b84d
I20260929 11:35:01.329757 14652 raft_consensus.cc:979] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.330369 14648 raft_consensus.cc:1067] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 3 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.332177 14406 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56922
I20260929 11:35:01.332826 14406 raft_consensus.cc:482] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:01.333200 14406 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:01.375816 14406 raft_consensus.cc:504] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.378482 14406 leader_election.cc:288] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 4 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:35:01.380124 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:35:01.381078 14333 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:01.381304 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:35:01.381875 14482 raft_consensus.cc:3032] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:35:01.382169 14482 raft_consensus.cc:729] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:35:01.382828 14482 consensus_queue.cc:260] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.383839 14482 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:01.427451 14650 raft_consensus.cc:979] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.427987 14653 raft_consensus.cc:1067] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.429641 14406 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56910
I20260929 11:35:01.430115 14406 raft_consensus.cc:482] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:01.430418 14406 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:01.448734 14652 raft_consensus.cc:979] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.449234 14648 raft_consensus.cc:1067] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 2 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.451058 14407 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56922
I20260929 11:35:01.451642 14407 raft_consensus.cc:482] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:01.451951 14407 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:01.453750 14650 raft_consensus.cc:979] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.454232 14650 raft_consensus.cc:1067] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.455821 14404 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56910
I20260929 11:35:01.456259 14404 raft_consensus.cc:482] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:01.456648 14404 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:01.483357 14482 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 4.
I20260929 11:35:01.483357 14333 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 4.
I20260929 11:35:01.483407 14406 raft_consensus.cc:504] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.485236 14373 leader_election.cc:302] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:35:01.487330 14406 leader_election.cc:288] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 3 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:35:01.488561 14646 raft_consensus.cc:2781] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:35:01.491880 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:35:01.492583 14333 raft_consensus.cc:3032] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:01.492952 14333 raft_consensus.cc:729] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:35:01.492537 14482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cbe706ebb9246b796a0bae50c449b92" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:35:01.493409 14482 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:01.493688 14333 consensus_queue.cc:260] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.494976 14333 raft_consensus.cc:3037] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:01.495841 14646 raft_consensus.cc:686] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 4 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:01.496887 14646 consensus_queue.cc:237] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.504468 14227 catalog_manager.cc:5495] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 3 to 4, leader changed from 525a4a04e06142f78e43891977a383c6 (127.13.221.195) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 4 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:01.516661 14653 raft_consensus.cc:979] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83: : Instructing follower 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.517136 14650 raft_consensus.cc:1067] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Signalling peer 097dfc79d5174f56924ea7a18ed0b84d to start an election
I20260929 11:35:01.518564 14406 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
from {username='slave'} at 127.0.0.1:56910
I20260929 11:35:01.519037 14406 raft_consensus.cc:482] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:01.519339 14406 raft_consensus.cc:3037] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:01.588974 14333 raft_consensus.cc:2454] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 3.
I20260929 11:35:01.589004 14407 raft_consensus.cc:504] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.589383 14404 raft_consensus.cc:504] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.588974 14482 raft_consensus.cc:2454] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 3.
I20260929 11:35:01.591922 14373 leader_election.cc:302] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6; no voters:
I20260929 11:35:01.593619 14404 leader_election.cc:288] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:35:01.594496 14332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:35:01.592098 14407 leader_election.cc:288] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 3 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:35:01.594846 14480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1729c996ec604d6ca7ada0f1469a02be" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:35:01.595080 14332 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:01.595409 14480 raft_consensus.cc:3032] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:01.595023 14646 raft_consensus.cc:2781] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:01.595768 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:35:01.596032 14646 raft_consensus.cc:686] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:01.596359 14483 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:01.596931 14646 consensus_queue.cc:237] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.595023 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:35:01.600073 14334 raft_consensus.cc:3032] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:01.600487 14334 raft_consensus.cc:729] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:35:01.601220 14334 consensus_queue.cc:260] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.595788 14480 raft_consensus.cc:729] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:35:01.602569 14334 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:01.602640 14480 consensus_queue.cc:260] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.603991 14480 raft_consensus.cc:3037] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:01.609222 14227 catalog_manager.cc:5495] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 2 to 3, leader changed from a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 3 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:01.687641 14483 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:35:01.687666 14406 raft_consensus.cc:504] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:35:01.691711 14406 leader_election.cc:288] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:35:01.692849 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:35:01.693403 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0448d5b15d4a9dad99a17f41370a3f" candidate_uuid: "097dfc79d5174f56924ea7a18ed0b84d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:35:01.693569 14333 raft_consensus.cc:3032] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:01.693620 14332 raft_consensus.cc:2454] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 3.
I20260929 11:35:01.693965 14483 raft_consensus.cc:3037] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:01.693938 14333 raft_consensus.cc:729] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:35:01.694888 14333 consensus_queue.cc:260] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:35:01.695318 14373 leader_election.cc:302] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:35:01.696218 14646 raft_consensus.cc:2781] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:01.696310 14373 leader_election.cc:302] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6; no voters:
I20260929 11:35:01.699901 14333 raft_consensus.cc:3037] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:01.700785 14654 raft_consensus.cc:2781] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:01.700399 14646 raft_consensus.cc:686] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 3 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:01.702150 14654 raft_consensus.cc:686] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:01.702577 14646 consensus_queue.cc:237] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.702991 14654 consensus_queue.cc:237] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:01.711194 14227 catalog_manager.cc:5495] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 2 to 3, leader changed from 525a4a04e06142f78e43891977a383c6 (127.13.221.195) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 3 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:01.721537 14227 catalog_manager.cc:5495] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 1 to 2, leader changed from a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 2 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:01.791545 14334 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:35:01.791693 14483 raft_consensus.cc:2454] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:35:01.791545 14480 raft_consensus.cc:2454] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 3.
I20260929 11:35:01.793062 14373 leader_election.cc:302] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6; no voters:
I20260929 11:35:01.794262 14646 raft_consensus.cc:2781] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:01.794869 14646 raft_consensus.cc:686] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Leader. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:01.795928 14646 consensus_queue.cc:237] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } }
I20260929 11:35:01.803257 14227 catalog_manager.cc:5495] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d reported cstate change: term changed from 1 to 2, leader changed from a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193) to 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194). New cstate: current_term: 2 leader_uuid: "097dfc79d5174f56924ea7a18ed0b84d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:01.896297 14333 raft_consensus.cc:2454] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 097dfc79d5174f56924ea7a18ed0b84d in term 2.
I20260929 11:35:02.002202 14333 raft_consensus.cc:1261] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 4 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:35:02.003461 14646 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:35:02.010202 14480 raft_consensus.cc:1261] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:02.012087 14654 consensus_queue.cc:1035] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:02.018548 14480 raft_consensus.cc:1261] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 4 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:35:02.020071 14667 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:35:02.030681 14333 raft_consensus.cc:1261] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:02.033378 14646 consensus_queue.cc:1035] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:02.187449 14333 raft_consensus.cc:1261] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:02.188993 14646 consensus_queue.cc:1035] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:35:02.201841 14480 raft_consensus.cc:1261] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:02.203399 14661 consensus_queue.cc:1035] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:35:02.212049 14333 raft_consensus.cc:1261] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:02.213284 14661 consensus_queue.cc:1035] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:02.219126 14480 raft_consensus.cc:1261] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:02.220891 14646 consensus_queue.cc:1035] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:02.226310 14480 raft_consensus.cc:1261] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:02.227595 14646 consensus_queue.cc:1035] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:02.237622 14333 raft_consensus.cc:1261] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Refusing update from remote peer 097dfc79d5174f56924ea7a18ed0b84d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:02.239003 14661 consensus_queue.cc:1035] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:04.341727 14199 auto_leader_rebalancer-test.cc:303] The leader distribution is
I20260929 11:35:04.342474 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:04.349290 14406 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
mode: GRACEFUL
new_leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
from {username='slave'} at 127.0.0.1:42192
I20260929 11:35:04.350011 14406 raft_consensus.cc:595] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Received request to transfer leadership to TS a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:35:04.352504 14406 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
mode: GRACEFUL
new_leader_uuid: "525a4a04e06142f78e43891977a383c6"
from {username='slave'} at 127.0.0.1:42192
I20260929 11:35:04.353145 14406 raft_consensus.cc:595] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Received request to transfer leadership to TS 525a4a04e06142f78e43891977a383c6
I20260929 11:35:04.355305 14406 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
mode: GRACEFUL
new_leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
from {username='slave'} at 127.0.0.1:42192
I20260929 11:35:04.355844 14406 raft_consensus.cc:595] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Received request to transfer leadership to TS a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:35:04.358055 14406 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
mode: GRACEFUL
new_leader_uuid: "525a4a04e06142f78e43891977a383c6"
from {username='slave'} at 127.0.0.1:42192
I20260929 11:35:04.358592 14406 raft_consensus.cc:595] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 4 LEADER]: Received request to transfer leadership to TS 525a4a04e06142f78e43891977a383c6
I20260929 11:35:04.361423 14406 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132"
dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
mode: GRACEFUL
new_leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
from {username='slave'} at 127.0.0.1:42192
I20260929 11:35:04.361943 14406 raft_consensus.cc:595] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Received request to transfer leadership to TS a8503b7fe7ae4d89b3497b3634d62f83
I20260929 11:35:04.362941 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260929 11:35:04.363422 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:04.381371 14681 raft_consensus.cc:979] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d: : Instructing follower a8503b7fe7ae4d89b3497b3634d62f83 to start an election
I20260929 11:35:04.381867 14680 raft_consensus.cc:1067] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Signalling peer a8503b7fe7ae4d89b3497b3634d62f83 to start an election
I20260929 11:35:04.383283 14334 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
from {username='slave'} at 127.0.0.1:39436
I20260929 11:35:04.383808 14334 raft_consensus.cc:482] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:04.384092 14334 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.424216 14334 raft_consensus.cc:504] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.427575 14334 leader_election.cc:288] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 3 election: Requested vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:35:04.427917 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:35:04.427784 14406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b912ab72f4fb47d8a229cf8da3d8a132" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:35:04.428694 14483 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.429049 14406 raft_consensus.cc:3032] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:04.429505 14406 raft_consensus.cc:729] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:04.430302 14406 consensus_queue.cc:260] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.431557 14406 raft_consensus.cc:3037] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.489153 14681 raft_consensus.cc:979] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d: : Instructing follower a8503b7fe7ae4d89b3497b3634d62f83 to start an election
I20260929 11:35:04.489594 14680 raft_consensus.cc:1067] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Signalling peer a8503b7fe7ae4d89b3497b3634d62f83 to start an election
I20260929 11:35:04.490979 14334 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
from {username='slave'} at 127.0.0.1:39436
I20260929 11:35:04.491602 14334 raft_consensus.cc:482] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:04.491943 14334 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.521253 14681 raft_consensus.cc:979] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d: : Instructing follower 525a4a04e06142f78e43891977a383c6 to start an election
I20260929 11:35:04.521701 14680 raft_consensus.cc:1067] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 4 LEADER]: Signalling peer 525a4a04e06142f78e43891977a383c6 to start an election
I20260929 11:35:04.523034 14480 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
from {username='slave'} at 127.0.0.1:55736
I20260929 11:35:04.523567 14480 raft_consensus.cc:482] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:04.523847 14480 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:35:04.527947 14406 raft_consensus.cc:2454] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 3.
I20260929 11:35:04.528036 14334 raft_consensus.cc:504] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.529608 14483 raft_consensus.cc:2454] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 3.
I20260929 11:35:04.531526 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:35:04.532135 14483 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.532375 14298 leader_election.cc:302] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:35:04.535106 14406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd48a7ba55048e7ac69547ba6e5c0e7" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:35:04.535097 14334 leader_election.cc:288] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 3 election: Requested vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:35:04.535503 14682 raft_consensus.cc:2781] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:04.535931 14406 raft_consensus.cc:3032] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:04.536659 14406 raft_consensus.cc:729] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:04.536942 14682 raft_consensus.cc:686] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:35:04.537982 14406 consensus_queue.cc:260] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.537971 14682 consensus_queue.cc:237] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.539209 14406 raft_consensus.cc:3037] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.548308 14230 catalog_manager.cc:5495] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 2 to 3, leader changed from 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194) to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:04.604755 14681 raft_consensus.cc:979] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d: : Instructing follower a8503b7fe7ae4d89b3497b3634d62f83 to start an election
I20260929 11:35:04.605227 14680 raft_consensus.cc:1067] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Signalling peer a8503b7fe7ae4d89b3497b3634d62f83 to start an election
I20260929 11:35:04.606877 14334 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a"
dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
from {username='slave'} at 127.0.0.1:39436
I20260929 11:35:04.607419 14334 raft_consensus.cc:482] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:04.607789 14334 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.630932 14483 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 3.
I20260929 11:35:04.630793 14334 raft_consensus.cc:504] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.631585 14406 raft_consensus.cc:2454] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 3.
I20260929 11:35:04.632215 14298 leader_election.cc:302] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:35:04.633072 14334 leader_election.cc:288] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 3 election: Requested vote from peers 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939), 525a4a04e06142f78e43891977a383c6 (127.13.221.195:42009)
I20260929 11:35:04.633903 14682 raft_consensus.cc:2781] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:04.634009 14406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:35:04.634140 14483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3df73c02af49482f860c4e009d0a701a" candidate_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "525a4a04e06142f78e43891977a383c6"
I20260929 11:35:04.634485 14682 raft_consensus.cc:686] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:35:04.634650 14406 raft_consensus.cc:3032] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:04.634678 14483 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.635052 14406 raft_consensus.cc:729] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:04.635426 14682 consensus_queue.cc:237] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.635893 14406 consensus_queue.cc:260] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.637210 14406 raft_consensus.cc:3037] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.630632 14480 raft_consensus.cc:504] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.643227 14334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:35:04.643920 14334 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:35:04.648063 14404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac01d714feec4ddb97745c82793c4009" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:35:04.648722 14404 raft_consensus.cc:3032] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 4 LEADER]: Stepping down as leader of term 4
I20260929 11:35:04.649040 14404 raft_consensus.cc:729] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:04.649781 14404 consensus_queue.cc:260] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.650766 14404 raft_consensus.cc:3037] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:35:04.651083 14480 leader_election.cc:288] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 5 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:35:04.652551 14680 raft_consensus.cc:979] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d: : Instructing follower 525a4a04e06142f78e43891977a383c6 to start an election
I20260929 11:35:04.653143 14681 raft_consensus.cc:1067] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Signalling peer 525a4a04e06142f78e43891977a383c6 to start an election
I20260929 11:35:04.654623 14480 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716"
dest_uuid: "525a4a04e06142f78e43891977a383c6"
from {username='slave'} at 127.0.0.1:55736
I20260929 11:35:04.655133 14480 raft_consensus.cc:482] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:04.655455 14480 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.656296 14230 catalog_manager.cc:5495] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 2 to 3, leader changed from 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194) to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:04.731818 14406 raft_consensus.cc:2454] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 3.
I20260929 11:35:04.731818 14483 raft_consensus.cc:2454] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8503b7fe7ae4d89b3497b3634d62f83 in term 3.
I20260929 11:35:04.734611 14298 leader_election.cc:302] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:35:04.731813 14334 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 5.
I20260929 11:35:04.735998 14682 raft_consensus.cc:2781] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:04.736621 14331 raft_consensus.cc:1226] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 5 FOLLOWER]: Rejecting Update request from peer 097dfc79d5174f56924ea7a18ed0b84d for earlier term 4. Current term is 5. Ops: []
I20260929 11:35:04.737205 14682 raft_consensus.cc:686] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 LEADER]: Becoming Leader. State: Replica: a8503b7fe7ae4d89b3497b3634d62f83, State: Running, Role: LEADER
I20260929 11:35:04.738684 14447 leader_election.cc:302] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 525a4a04e06142f78e43891977a383c6, a8503b7fe7ae4d89b3497b3634d62f83; no voters:
I20260929 11:35:04.738230 14682 consensus_queue.cc:237] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.739562 14648 raft_consensus.cc:2781] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:35:04.741106 14648 raft_consensus.cc:686] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 5 LEADER]: Becoming Leader. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:35:04.742656 14648 consensus_queue.cc:237] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.747228 14230 catalog_manager.cc:5495] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 reported cstate change: term changed from 2 to 3, leader changed from 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194) to a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:04.751449 14227 catalog_manager.cc:5495] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 reported cstate change: term changed from 4 to 5, leader changed from 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194) to 525a4a04e06142f78e43891977a383c6 (127.13.221.195). New cstate: current_term: 5 leader_uuid: "525a4a04e06142f78e43891977a383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:04.836908 14404 raft_consensus.cc:2454] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 5.
I20260929 11:35:04.836944 14480 raft_consensus.cc:504] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.839309 14480 leader_election.cc:288] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 3 election: Requested vote from peers a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349), 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939)
I20260929 11:35:04.839835 14331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8503b7fe7ae4d89b3497b3634d62f83"
I20260929 11:35:04.839920 14404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7992bb78a4f14c8685a8f81bf15e1716" candidate_uuid: "525a4a04e06142f78e43891977a383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "097dfc79d5174f56924ea7a18ed0b84d"
I20260929 11:35:04.840670 14331 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.840695 14404 raft_consensus.cc:3032] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:04.841220 14404 raft_consensus.cc:729] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 097dfc79d5174f56924ea7a18ed0b84d, State: Running, Role: LEADER
I20260929 11:35:04.842020 14404 consensus_queue.cc:260] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.843809 14404 raft_consensus.cc:3037] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:04.939039 14404 raft_consensus.cc:2454] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 3.
I20260929 11:35:04.939062 14331 raft_consensus.cc:2454] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 525a4a04e06142f78e43891977a383c6 in term 3.
I20260929 11:35:04.940837 14446 leader_election.cc:302] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097dfc79d5174f56924ea7a18ed0b84d, 525a4a04e06142f78e43891977a383c6; no voters:
I20260929 11:35:04.941685 14648 raft_consensus.cc:2781] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:04.942145 14648 raft_consensus.cc:686] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 3 LEADER]: Becoming Leader. State: Replica: 525a4a04e06142f78e43891977a383c6, State: Running, Role: LEADER
I20260929 11:35:04.942981 14648 consensus_queue.cc:237] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } }
I20260929 11:35:04.950043 14227 catalog_manager.cc:5495] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 reported cstate change: term changed from 2 to 3, leader changed from 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194) to 525a4a04e06142f78e43891977a383c6 (127.13.221.195). New cstate: current_term: 3 leader_uuid: "525a4a04e06142f78e43891977a383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:05.009902 14404 raft_consensus.cc:1261] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Refusing update from remote peer a8503b7fe7ae4d89b3497b3634d62f83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:05.011111 14682 consensus_queue.cc:1035] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:05.021515 14480 raft_consensus.cc:1261] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Refusing update from remote peer a8503b7fe7ae4d89b3497b3634d62f83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:05.023020 14683 consensus_queue.cc:1035] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260929 11:35:05.037827 14504 debug-util.cc:398] Leaking SignalData structure 0x7b0800174060 after lost signal to thread 14202
W20260929 11:35:05.038743 14504 debug-util.cc:398] Leaking SignalData structure 0x7b0800174740 after lost signal to thread 14265
W20260929 11:35:05.039683 14504 debug-util.cc:398] Leaking SignalData structure 0x7b0800160640 after lost signal to thread 14358
W20260929 11:35:05.040997 14504 debug-util.cc:398] Leaking SignalData structure 0x7b0800090060 after lost signal to thread 14433
W20260929 11:35:05.041648 14504 debug-util.cc:398] Leaking SignalData structure 0x7b0800119400 after lost signal to thread 14507
I20260929 11:35:05.056741 14404 raft_consensus.cc:1261] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Refusing update from remote peer a8503b7fe7ae4d89b3497b3634d62f83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:05.058174 14683 consensus_queue.cc:1035] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:05.077675 14480 raft_consensus.cc:1261] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Refusing update from remote peer a8503b7fe7ae4d89b3497b3634d62f83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:05.079941 14683 consensus_queue.cc:1035] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:35:05.136418 14331 raft_consensus.cc:1261] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 5 FOLLOWER]: Refusing update from remote peer 525a4a04e06142f78e43891977a383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260929 11:35:05.137748 14648 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:35:05.147619 14404 raft_consensus.cc:1261] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 5 FOLLOWER]: Refusing update from remote peer 525a4a04e06142f78e43891977a383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260929 11:35:05.149463 14648 consensus_queue.cc:1035] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:35:05.227533 14404 raft_consensus.cc:1261] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Refusing update from remote peer a8503b7fe7ae4d89b3497b3634d62f83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:05.228858 14682 consensus_queue.cc:1035] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:05.238523 14483 raft_consensus.cc:1261] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Refusing update from remote peer a8503b7fe7ae4d89b3497b3634d62f83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:05.240245 14682 consensus_queue.cc:1035] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "525a4a04e06142f78e43891977a383c6" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 42009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:35:05.360302 14331 raft_consensus.cc:1261] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Refusing update from remote peer 525a4a04e06142f78e43891977a383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:05.361526 14648 consensus_queue.cc:1035] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8503b7fe7ae4d89b3497b3634d62f83" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:05.364310 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:05.373507 14404 raft_consensus.cc:1261] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Refusing update from remote peer 525a4a04e06142f78e43891977a383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:05.381269 14705 consensus_queue.cc:1035] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "097dfc79d5174f56924ea7a18ed0b84d" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:35:05.386899 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:05.387606 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:06.388733 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:06.396677 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:06.397218 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:07.398069 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:07.403035 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:07.403388 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:08.404127 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:08.408634 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:08.408959 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:09.409642 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:09.414284 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:09.414788 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:10.415557 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:10.422204 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:10.422735 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:11.423576 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:11.429030 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:11.429533 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:12.430260 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:12.434893 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:12.435330 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:13.436069 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:13.440781 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:13.441195 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:14.468515 14199 auto_leader_rebalancer-test.cc:314] The leader distribution is
I20260929 11:35:14.469374 14199 tablet_server.cc:178] TabletServer@127.13.221.193:0 shutting down...
I20260929 11:35:14.500305 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:35:14.501159 14199 tablet_replica.cc:330] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.502286 14199 raft_consensus.cc:2229] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.503125 14199 raft_consensus.cc:2258] T 1729c996ec604d6ca7ada0f1469a02be P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.505504 14199 tablet_replica.cc:330] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.505949 14199 raft_consensus.cc:2229] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.506762 14199 raft_consensus.cc:2258] T 3df73c02af49482f860c4e009d0a701a P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.508484 14199 tablet_replica.cc:330] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.508913 14199 raft_consensus.cc:2229] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.509356 14199 raft_consensus.cc:2258] T 8c0448d5b15d4a9dad99a17f41370a3f P a8503b7fe7ae4d89b3497b3634d62f83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.510974 14199 tablet_replica.cc:330] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.511390 14199 raft_consensus.cc:2229] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.512079 14199 raft_consensus.cc:2258] T b912ab72f4fb47d8a229cf8da3d8a132 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.513636 14199 tablet_replica.cc:330] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.514072 14199 raft_consensus.cc:2229] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.514428 14199 raft_consensus.cc:2258] T 4e62a341d904422c8f1e073281f9c51e P a8503b7fe7ae4d89b3497b3634d62f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.515930 14199 tablet_replica.cc:330] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.516418 14199 raft_consensus.cc:2229] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.516819 14199 raft_consensus.cc:2258] T 7992bb78a4f14c8685a8f81bf15e1716 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.518368 14199 tablet_replica.cc:330] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.518777 14199 raft_consensus.cc:2229] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.519490 14199 raft_consensus.cc:2258] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.521432 14199 tablet_replica.cc:330] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.521850 14199 raft_consensus.cc:2229] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.522224 14199 raft_consensus.cc:2258] T 2cbe706ebb9246b796a0bae50c449b92 P a8503b7fe7ae4d89b3497b3634d62f83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.523707 14199 tablet_replica.cc:330] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83: stopping tablet replica
I20260929 11:35:14.524102 14199 raft_consensus.cc:2229] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.524741 14199 raft_consensus.cc:2258] T ac01d714feec4ddb97745c82793c4009 P a8503b7fe7ae4d89b3497b3634d62f83 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.610206 14199 tablet_server.cc:194] TabletServer@127.13.221.193:0 shutdown complete.
W20260929 11:35:14.614959 14373 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.221.193:35349: connect: Connection refused (error 111)
W20260929 11:35:14.618777 14373 consensus_peers.cc:487] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d -> Peer a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349): Couldn't send request to peer a8503b7fe7ae4d89b3497b3634d62f83. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:35349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260929 11:35:14.626308 14373 consensus_peers.cc:487] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d -> Peer a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349): Couldn't send request to peer a8503b7fe7ae4d89b3497b3634d62f83. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:35349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:14.631901 14199 tablet_server.cc:178] TabletServer@127.13.221.194:0 shutting down...
I20260929 11:35:14.661383 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:35:14.662154 14199 tablet_replica.cc:330] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.663156 14199 raft_consensus.cc:2229] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.663822 14199 raft_consensus.cc:2258] T 3df73c02af49482f860c4e009d0a701a P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.665601 14199 tablet_replica.cc:330] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.666057 14199 raft_consensus.cc:2229] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.666441 14199 raft_consensus.cc:2258] T b912ab72f4fb47d8a229cf8da3d8a132 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.668025 14199 tablet_replica.cc:330] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.668593 14199 raft_consensus.cc:2229] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.669356 14199 raft_consensus.cc:2258] T 2cbe706ebb9246b796a0bae50c449b92 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.670794 14199 tablet_replica.cc:330] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.671208 14199 raft_consensus.cc:2229] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.671563 14199 raft_consensus.cc:2258] T ac01d714feec4ddb97745c82793c4009 P 097dfc79d5174f56924ea7a18ed0b84d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.673141 14199 tablet_replica.cc:330] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.673574 14199 raft_consensus.cc:2229] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.673921 14199 raft_consensus.cc:2258] T 7992bb78a4f14c8685a8f81bf15e1716 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.675272 14199 tablet_replica.cc:330] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.675685 14199 raft_consensus.cc:2229] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.676019 14199 raft_consensus.cc:2258] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.677671 14199 tablet_replica.cc:330] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.678148 14199 raft_consensus.cc:2229] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.678471 14199 raft_consensus.cc:2258] T 4e62a341d904422c8f1e073281f9c51e P 097dfc79d5174f56924ea7a18ed0b84d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.680018 14199 tablet_replica.cc:330] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.680548 14199 raft_consensus.cc:2229] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.681226 14199 raft_consensus.cc:2258] T 1729c996ec604d6ca7ada0f1469a02be P 097dfc79d5174f56924ea7a18ed0b84d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.682667 14199 tablet_replica.cc:330] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d: stopping tablet replica
I20260929 11:35:14.683027 14199 raft_consensus.cc:2229] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.683691 14199 raft_consensus.cc:2258] T 8c0448d5b15d4a9dad99a17f41370a3f P 097dfc79d5174f56924ea7a18ed0b84d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260929 11:35:14.689795 14446 consensus_peers.cc:487] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 -> Peer 097dfc79d5174f56924ea7a18ed0b84d (127.13.221.194:35939): Couldn't send request to peer 097dfc79d5174f56924ea7a18ed0b84d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:14.712644 14199 tablet_server.cc:194] TabletServer@127.13.221.194:0 shutdown complete.
W20260929 11:35:14.715325 14447 consensus_peers.cc:487] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 -> Peer a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349): Couldn't send request to peer a8503b7fe7ae4d89b3497b3634d62f83. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:35349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:14.729769 14199 tablet_server.cc:178] TabletServer@127.13.221.195:0 shutting down...
W20260929 11:35:14.754331 14447 consensus_peers.cc:487] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 -> Peer a8503b7fe7ae4d89b3497b3634d62f83 (127.13.221.193:35349): Couldn't send request to peer a8503b7fe7ae4d89b3497b3634d62f83. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:35349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:14.756851 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:35:14.757510 14199 tablet_replica.cc:330] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.758100 14199 raft_consensus.cc:2229] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.758544 14199 raft_consensus.cc:2258] T 1729c996ec604d6ca7ada0f1469a02be P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.760385 14199 tablet_replica.cc:330] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.760883 14199 raft_consensus.cc:2229] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.761335 14199 raft_consensus.cc:2258] T 2cbe706ebb9246b796a0bae50c449b92 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.762887 14199 tablet_replica.cc:330] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.763366 14199 raft_consensus.cc:2229] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 5 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.764118 14199 raft_consensus.cc:2258] T ac01d714feec4ddb97745c82793c4009 P 525a4a04e06142f78e43891977a383c6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.765687 14199 tablet_replica.cc:330] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.766171 14199 raft_consensus.cc:2229] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.766546 14199 raft_consensus.cc:2258] T 8c0448d5b15d4a9dad99a17f41370a3f P 525a4a04e06142f78e43891977a383c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.768045 14199 tablet_replica.cc:330] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.768565 14199 raft_consensus.cc:2229] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.769304 14199 raft_consensus.cc:2258] T 4e62a341d904422c8f1e073281f9c51e P 525a4a04e06142f78e43891977a383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.770717 14199 tablet_replica.cc:330] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.771163 14199 raft_consensus.cc:2229] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.771574 14199 raft_consensus.cc:2258] T 7bd48a7ba55048e7ac69547ba6e5c0e7 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.773101 14199 tablet_replica.cc:330] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.773538 14199 raft_consensus.cc:2229] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.774281 14199 raft_consensus.cc:2258] T 7992bb78a4f14c8685a8f81bf15e1716 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.775815 14199 tablet_replica.cc:330] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.776310 14199 raft_consensus.cc:2229] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.776770 14199 raft_consensus.cc:2258] T 3df73c02af49482f860c4e009d0a701a P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.778294 14199 tablet_replica.cc:330] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6: stopping tablet replica
I20260929 11:35:14.778707 14199 raft_consensus.cc:2229] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:14.779110 14199 raft_consensus.cc:2258] T b912ab72f4fb47d8a229cf8da3d8a132 P 525a4a04e06142f78e43891977a383c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.821566 14199 tablet_server.cc:194] TabletServer@127.13.221.195:0 shutdown complete.
I20260929 11:35:14.838868 14199 master.cc:537] Master@127.13.221.254:37585 shutting down...
I20260929 11:35:14.959972 14199 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:35:14.960713 14199 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:14.961069 14199 tablet_replica.cc:330] T 00000000000000000000000000000000 P 500061ca42c54940afa7bace10982c88: stopping tablet replica
I20260929 11:35:14.979833 14199 master.cc:552] Master@127.13.221.254:37585 shutdown complete.
097dfc79d5174f56924ea7a18ed0b84d 4
525a4a04e06142f78e43891977a383c6 1
a8503b7fe7ae4d89b3497b3634d62f83 4
097dfc79d5174f56924ea7a18ed0b84d 3
525a4a04e06142f78e43891977a383c6 3
a8503b7fe7ae4d89b3497b3634d62f83 3
097dfc79d5174f56924ea7a18ed0b84d 8
525a4a04e06142f78e43891977a383c6 1
a8503b7fe7ae4d89b3497b3634d62f83 0
097dfc79d5174f56924ea7a18ed0b84d 3
525a4a04e06142f78e43891977a383c6 3
a8503b7fe7ae4d89b3497b3634d62f83 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (31249 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260929 11:35:15.018960 14199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.221.254:34045
I20260929 11:35:15.020073 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:15.026150 14725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:15.026335 14726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:15.027302 14728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:15.027779 14199 server_base.cc:1034] running on GCE node
I20260929 11:35:15.028852 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:15.029047 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:15.029247 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681715029213 us; error 0 us; skew 500 ppm
I20260929 11:35:15.029786 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:15.032493 14199 webserver.cc:460] Webserver started at http://127.13.221.254:46835/ using document root <none> and password file <none>
I20260929 11:35:15.033010 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:15.033200 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:15.033505 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:15.034686 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/master-0-root/instance:
uuid: "3ddef32929264bf2ae4afac74480a88a"
format_stamp: "Formatted at 2026-09-29 11:35:15 on dist-test-slave-szp1"
I20260929 11:35:15.039247 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260929 11:35:15.042630 14733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.043552 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260929 11:35:15.043817 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/master-0-root
uuid: "3ddef32929264bf2ae4afac74480a88a"
format_stamp: "Formatted at 2026-09-29 11:35:15 on dist-test-slave-szp1"
I20260929 11:35:15.044066 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:15.067281 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:15.068542 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:15.107228 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.254:34045
I20260929 11:35:15.107336 14784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.254:34045 every 8 connection(s)
I20260929 11:35:15.111330 14785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.120824 14785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a: Bootstrap starting.
I20260929 11:35:15.125157 14785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:15.129421 14785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a: No bootstrap required, opened a new log
I20260929 11:35:15.131465 14785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddef32929264bf2ae4afac74480a88a" member_type: VOTER }
I20260929 11:35:15.131929 14785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:15.132193 14785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ddef32929264bf2ae4afac74480a88a, State: Initialized, Role: FOLLOWER
I20260929 11:35:15.132869 14785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddef32929264bf2ae4afac74480a88a" member_type: VOTER }
I20260929 11:35:15.133334 14785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 11:35:15.133580 14785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 11:35:15.133895 14785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:15.137954 14785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddef32929264bf2ae4afac74480a88a" member_type: VOTER }
I20260929 11:35:15.138507 14785 leader_election.cc:302] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ddef32929264bf2ae4afac74480a88a; no voters:
I20260929 11:35:15.139730 14785 leader_election.cc:288] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 11:35:15.140146 14788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:15.141548 14788 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 1 LEADER]: Becoming Leader. State: Replica: 3ddef32929264bf2ae4afac74480a88a, State: Running, Role: LEADER
I20260929 11:35:15.142237 14788 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddef32929264bf2ae4afac74480a88a" member_type: VOTER }
I20260929 11:35:15.142843 14785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [sys.catalog]: configured and running, proceeding with master startup.
I20260929 11:35:15.147291 14789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ddef32929264bf2ae4afac74480a88a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddef32929264bf2ae4afac74480a88a" member_type: VOTER } }
I20260929 11:35:15.147212 14790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ddef32929264bf2ae4afac74480a88a. Latest consensus state: current_term: 1 leader_uuid: "3ddef32929264bf2ae4afac74480a88a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ddef32929264bf2ae4afac74480a88a" member_type: VOTER } }
I20260929 11:35:15.147897 14789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [sys.catalog]: This master's current role is: LEADER
I20260929 11:35:15.147948 14790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [sys.catalog]: This master's current role is: LEADER
I20260929 11:35:15.151660 14795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 11:35:15.159780 14795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 11:35:15.160930 14199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260929 11:35:15.168864 14795 catalog_manager.cc:1347] Generated new cluster ID: 9c6eaa7a81b74bdd8dbf5a1fff6593a9
I20260929 11:35:15.169245 14795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 11:35:15.184866 14795 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 11:35:15.187023 14795 catalog_manager.cc:1504] Loading token signing keys...
I20260929 11:35:15.210755 14795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a: Generated new TSK 0
I20260929 11:35:15.211602 14795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 11:35:15.227319 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:15.233191 14806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:15.234455 14807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:15.237252 14199 server_base.cc:1034] running on GCE node
W20260929 11:35:15.238544 14809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:15.239449 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:15.239629 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:15.239749 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681715239741 us; error 0 us; skew 500 ppm
I20260929 11:35:15.240228 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:15.242643 14199 webserver.cc:460] Webserver started at http://127.13.221.193:39143/ using document root <none> and password file <none>
I20260929 11:35:15.243184 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:15.243369 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:15.243656 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:15.244969 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-0-root/instance:
uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
format_stamp: "Formatted at 2026-09-29 11:35:15 on dist-test-slave-szp1"
I20260929 11:35:15.249580 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260929 11:35:15.252767 14814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.253517 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260929 11:35:15.253798 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-0-root
uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
format_stamp: "Formatted at 2026-09-29 11:35:15 on dist-test-slave-szp1"
I20260929 11:35:15.254093 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:15.267289 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:15.268644 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:15.270087 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:35:15.272285 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:35:15.272526 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.272771 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:35:15.272982 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.313648 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.193:42605
I20260929 11:35:15.313757 14876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.193:42605 every 8 connection(s)
I20260929 11:35:15.318521 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:15.326437 14881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:15.327625 14882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:15.330940 14884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:15.332680 14199 server_base.cc:1034] running on GCE node
I20260929 11:35:15.333688 14877 heartbeater.cc:347] Connected to a master server at 127.13.221.254:34045
I20260929 11:35:15.333781 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:15.334080 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:15.334081 14877 heartbeater.cc:464] Registering TS with master...
I20260929 11:35:15.334355 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681715334328 us; error 0 us; skew 500 ppm
I20260929 11:35:15.334930 14877 heartbeater.cc:511] Master 127.13.221.254:34045 requested a full tablet report, sending...
I20260929 11:35:15.334954 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:15.337443 14750 ts_manager.cc:194] Registered new tserver with Master: fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605)
I20260929 11:35:15.338294 14199 webserver.cc:460] Webserver started at http://127.13.221.194:34231/ using document root <none> and password file <none>
I20260929 11:35:15.338836 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:15.339047 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:15.339308 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:15.339635 14750 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34880
I20260929 11:35:15.340627 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-1-root/instance:
uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
format_stamp: "Formatted at 2026-09-29 11:35:15 on dist-test-slave-szp1"
I20260929 11:35:15.345292 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260929 11:35:15.348745 14889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.349496 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260929 11:35:15.349790 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-1-root
uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
format_stamp: "Formatted at 2026-09-29 11:35:15 on dist-test-slave-szp1"
I20260929 11:35:15.350047 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:15.371832 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:15.373222 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:15.374639 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:35:15.376876 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:35:15.377049 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.377333 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:35:15.377553 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.416834 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.194:33057
I20260929 11:35:15.416914 14951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.194:33057 every 8 connection(s)
I20260929 11:35:15.421360 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:15.429658 14955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:15.433184 14956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:15.434919 14958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:15.435981 14199 server_base.cc:1034] running on GCE node
I20260929 11:35:15.436925 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:15.437160 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:15.437342 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681715437322 us; error 0 us; skew 500 ppm
I20260929 11:35:15.437695 14952 heartbeater.cc:347] Connected to a master server at 127.13.221.254:34045
I20260929 11:35:15.437992 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:15.438095 14952 heartbeater.cc:464] Registering TS with master...
I20260929 11:35:15.439044 14952 heartbeater.cc:511] Master 127.13.221.254:34045 requested a full tablet report, sending...
I20260929 11:35:15.441128 14199 webserver.cc:460] Webserver started at http://127.13.221.195:39333/ using document root <none> and password file <none>
I20260929 11:35:15.441282 14750 ts_manager.cc:194] Registered new tserver with Master: 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:15.441744 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:15.441982 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:15.442242 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:15.443095 14750 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34884
I20260929 11:35:15.443576 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-2-root/instance:
uuid: "772cf848433a42958ebe6446e4623724"
format_stamp: "Formatted at 2026-09-29 11:35:15 on dist-test-slave-szp1"
I20260929 11:35:15.448684 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260929 11:35:15.452162 14963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.452996 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260929 11:35:15.453332 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-2-root
uuid: "772cf848433a42958ebe6446e4623724"
format_stamp: "Formatted at 2026-09-29 11:35:15 on dist-test-slave-szp1"
I20260929 11:35:15.453679 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790681683607964-14199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:15.468816 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:15.470063 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:15.471442 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:35:15.473783 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:35:15.474017 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.474262 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:35:15.474435 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:15.515288 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.195:36887
I20260929 11:35:15.515383 15025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.195:36887 every 8 connection(s)
I20260929 11:35:15.531260 15026 heartbeater.cc:347] Connected to a master server at 127.13.221.254:34045
I20260929 11:35:15.531607 15026 heartbeater.cc:464] Registering TS with master...
I20260929 11:35:15.532214 15026 heartbeater.cc:511] Master 127.13.221.254:34045 requested a full tablet report, sending...
I20260929 11:35:15.534035 14750 ts_manager.cc:194] Registered new tserver with Master: 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:15.534422 14199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015803408s
I20260929 11:35:15.535638 14750 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34894
I20260929 11:35:15.536991 14199 test_util.cc:268] Using random seed: -1819315127
I20260929 11:35:15.563349 14750 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34900:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 11:35:15.566176 14750 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 11:35:15.650609 14842 tablet_service.cc:1467] Processing CreateTablet for tablet 8f4a732e806e42b6a50a50e5cff2f84c (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260929 11:35:15.652197 14842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f4a732e806e42b6a50a50e5cff2f84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.652468 14838 tablet_service.cc:1467] Processing CreateTablet for tablet c44d0aeb5caf415c92faf30e5b5eaffa (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260929 11:35:15.653502 14991 tablet_service.cc:1467] Processing CreateTablet for tablet 8f4a732e806e42b6a50a50e5cff2f84c (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260929 11:35:15.653694 14837 tablet_service.cc:1467] Processing CreateTablet for tablet 27557cca002843eeaab4de5b3dc4a72c (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260929 11:35:15.654803 14991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f4a732e806e42b6a50a50e5cff2f84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.655260 14839 tablet_service.cc:1467] Processing CreateTablet for tablet 8f8bafaf01974fa2819e59aa962defa9 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260929 11:35:15.655959 14836 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3dc7ce7d894cb2ac31f3501adef337 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260929 11:35:15.656802 14834 tablet_service.cc:1467] Processing CreateTablet for tablet 03fc552d01a54c5587e1b1bf2f12a9b2 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260929 11:35:15.657557 14840 tablet_service.cc:1467] Processing CreateTablet for tablet 49235c43d61f495297d42cfcbb5d7630 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260929 11:35:15.658267 14835 tablet_service.cc:1467] Processing CreateTablet for tablet cc7b64fd5dc148b78df202c4b688927f (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260929 11:35:15.653906 14838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44d0aeb5caf415c92faf30e5b5eaffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.660921 14840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49235c43d61f495297d42cfcbb5d7630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.660975 14833 tablet_service.cc:1467] Processing CreateTablet for tablet 863f8641fd5e43f59b2a37b31989144a (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260929 11:35:15.662395 14833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863f8641fd5e43f59b2a37b31989144a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.650796 14841 tablet_service.cc:1467] Processing CreateTablet for tablet cab678679af24b559ffde00ab2cddc81 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260929 11:35:15.665195 14839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f8bafaf01974fa2819e59aa962defa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.665817 14835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7b64fd5dc148b78df202c4b688927f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.668666 14841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab678679af24b559ffde00ab2cddc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.672701 14836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3dc7ce7d894cb2ac31f3501adef337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.672453 14990 tablet_service.cc:1467] Processing CreateTablet for tablet cab678679af24b559ffde00ab2cddc81 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260929 11:35:15.673794 14990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab678679af24b559ffde00ab2cddc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.676705 14834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03fc552d01a54c5587e1b1bf2f12a9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.679423 14837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27557cca002843eeaab4de5b3dc4a72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.682720 14989 tablet_service.cc:1467] Processing CreateTablet for tablet 49235c43d61f495297d42cfcbb5d7630 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260929 11:35:15.686023 14988 tablet_service.cc:1467] Processing CreateTablet for tablet 8f8bafaf01974fa2819e59aa962defa9 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260929 11:35:15.689916 14986 tablet_service.cc:1467] Processing CreateTablet for tablet 27557cca002843eeaab4de5b3dc4a72c (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260929 11:35:15.691658 14982 tablet_service.cc:1467] Processing CreateTablet for tablet 863f8641fd5e43f59b2a37b31989144a (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260929 11:35:15.694445 14985 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3dc7ce7d894cb2ac31f3501adef337 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260929 11:35:15.697580 14917 tablet_service.cc:1467] Processing CreateTablet for tablet 8f4a732e806e42b6a50a50e5cff2f84c (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260929 11:35:15.699404 14917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f4a732e806e42b6a50a50e5cff2f84c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.699270 14911 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3dc7ce7d894cb2ac31f3501adef337 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260929 11:35:15.700606 14911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3dc7ce7d894cb2ac31f3501adef337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.701961 14916 tablet_service.cc:1467] Processing CreateTablet for tablet cab678679af24b559ffde00ab2cddc81 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260929 11:35:15.703724 14916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab678679af24b559ffde00ab2cddc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.706010 14914 tablet_service.cc:1467] Processing CreateTablet for tablet 8f8bafaf01974fa2819e59aa962defa9 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260929 11:35:15.707798 14914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f8bafaf01974fa2819e59aa962defa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.710038 14913 tablet_service.cc:1467] Processing CreateTablet for tablet c44d0aeb5caf415c92faf30e5b5eaffa (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260929 11:35:15.711225 14910 tablet_service.cc:1467] Processing CreateTablet for tablet cc7b64fd5dc148b78df202c4b688927f (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260929 11:35:15.711903 14913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44d0aeb5caf415c92faf30e5b5eaffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.717772 14983 tablet_service.cc:1467] Processing CreateTablet for tablet 03fc552d01a54c5587e1b1bf2f12a9b2 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260929 11:35:15.719661 14984 tablet_service.cc:1467] Processing CreateTablet for tablet cc7b64fd5dc148b78df202c4b688927f (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260929 11:35:15.721570 14987 tablet_service.cc:1467] Processing CreateTablet for tablet c44d0aeb5caf415c92faf30e5b5eaffa (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260929 11:35:15.715229 14909 tablet_service.cc:1467] Processing CreateTablet for tablet 03fc552d01a54c5587e1b1bf2f12a9b2 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260929 11:35:15.716375 14915 tablet_service.cc:1467] Processing CreateTablet for tablet 49235c43d61f495297d42cfcbb5d7630 (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260929 11:35:15.714037 14912 tablet_service.cc:1467] Processing CreateTablet for tablet 27557cca002843eeaab4de5b3dc4a72c (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260929 11:35:15.726157 14989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49235c43d61f495297d42cfcbb5d7630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.726833 14983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03fc552d01a54c5587e1b1bf2f12a9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.727456 14987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44d0aeb5caf415c92faf30e5b5eaffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.728037 14984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7b64fd5dc148b78df202c4b688927f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.730393 14986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27557cca002843eeaab4de5b3dc4a72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.731292 14985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3dc7ce7d894cb2ac31f3501adef337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.731281 14909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03fc552d01a54c5587e1b1bf2f12a9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.732918 14915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49235c43d61f495297d42cfcbb5d7630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.734151 14912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27557cca002843eeaab4de5b3dc4a72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.734495 14988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f8bafaf01974fa2819e59aa962defa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.735721 14910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc7b64fd5dc148b78df202c4b688927f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.744134 14982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863f8641fd5e43f59b2a37b31989144a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.833870 15041 tablet_bootstrap.cc:492] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:15.841750 14908 tablet_service.cc:1467] Processing CreateTablet for tablet 863f8641fd5e43f59b2a37b31989144a (DEFAULT_TABLE table=test-workload [id=89654930c6cc4f30972bed6515172eaf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260929 11:35:15.844475 14908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863f8641fd5e43f59b2a37b31989144a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:15.840574 15041 tablet_bootstrap.cc:654] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:15.866062 15043 tablet_bootstrap.cc:492] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:15.879010 15041 tablet_bootstrap.cc:492] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:15.879657 15041 ts_tablet_manager.cc:1397] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.011s
I20260929 11:35:15.883241 15041 raft_consensus.cc:348] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:15.890548 15043 tablet_bootstrap.cc:654] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:15.884258 15041 raft_consensus.cc:374] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:15.892733 15041 raft_consensus.cc:729] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:15.899374 15041 consensus_queue.cc:260] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:15.908969 15042 tablet_bootstrap.cc:492] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:15.948858 15041 ts_tablet_manager.cc:1428] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.069s user 0.019s sys 0.030s
I20260929 11:35:15.949872 15041 tablet_bootstrap.cc:492] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:15.950567 14877 heartbeater.cc:503] Master 127.13.221.254:34045 was elected leader, sending a full tablet report...
I20260929 11:35:15.993899 15042 tablet_bootstrap.cc:654] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:15.995671 15043 tablet_bootstrap.cc:492] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:15.996304 15043 ts_tablet_manager.cc:1397] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.131s user 0.046s sys 0.047s
I20260929 11:35:16.000814 15043 raft_consensus.cc:348] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.001858 15041 tablet_bootstrap.cc:654] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.002195 15043 raft_consensus.cc:374] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.002758 15043 raft_consensus.cc:729] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.003924 15043 consensus_queue.cc:260] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.021641 15043 ts_tablet_manager.cc:1428] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.025s user 0.014s sys 0.007s
I20260929 11:35:16.022820 14952 heartbeater.cc:503] Master 127.13.221.254:34045 was elected leader, sending a full tablet report...
I20260929 11:35:16.024919 15043 tablet_bootstrap.cc:492] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.036396 15043 tablet_bootstrap.cc:654] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.039091 15042 tablet_bootstrap.cc:492] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.039296 15041 tablet_bootstrap.cc:492] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.039726 15042 ts_tablet_manager.cc:1397] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.131s user 0.023s sys 0.017s
I20260929 11:35:16.039894 15041 ts_tablet_manager.cc:1397] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.090s user 0.017s sys 0.013s
I20260929 11:35:16.042946 15042 raft_consensus.cc:348] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.044097 15042 raft_consensus.cc:374] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.043669 15041 raft_consensus.cc:348] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.044529 15042 raft_consensus.cc:729] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.044699 15041 raft_consensus.cc:374] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.045156 15041 raft_consensus.cc:729] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.045634 15042 consensus_queue.cc:260] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.046144 15041 consensus_queue.cc:260] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.054898 15026 heartbeater.cc:503] Master 127.13.221.254:34045 was elected leader, sending a full tablet report...
I20260929 11:35:16.055797 15043 tablet_bootstrap.cc:492] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:16.056293 15043 ts_tablet_manager.cc:1397] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.013s
I20260929 11:35:16.057010 15041 ts_tablet_manager.cc:1428] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.017s user 0.007s sys 0.001s
I20260929 11:35:16.057021 15042 ts_tablet_manager.cc:1428] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.017s user 0.004s sys 0.004s
I20260929 11:35:16.058777 15042 tablet_bootstrap.cc:492] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.060403 15041 tablet_bootstrap.cc:492] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:16.058961 15043 raft_consensus.cc:348] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.060877 15043 raft_consensus.cc:374] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.061233 15043 raft_consensus.cc:729] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.062048 15043 consensus_queue.cc:260] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.064606 15043 ts_tablet_manager.cc:1428] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260929 11:35:16.065583 15043 tablet_bootstrap.cc:492] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.066778 15041 tablet_bootstrap.cc:654] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.071683 15043 tablet_bootstrap.cc:654] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.071842 15042 tablet_bootstrap.cc:654] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.077723 15052 raft_consensus.cc:482] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.078699 15041 tablet_bootstrap.cc:492] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.079286 15041 ts_tablet_manager.cc:1397] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.008s
I20260929 11:35:16.078255 15052 raft_consensus.cc:504] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.083877 15041 raft_consensus.cc:348] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.084686 15041 raft_consensus.cc:374] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.086580 15041 raft_consensus.cc:729] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.087641 15041 consensus_queue.cc:260] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.096084 15041 ts_tablet_manager.cc:1428] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260929 11:35:16.097431 15041 tablet_bootstrap.cc:492] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:16.100652 15052 leader_election.cc:288] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.102982 15042 tablet_bootstrap.cc:492] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.103499 15042 ts_tablet_manager.cc:1397] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.008s
I20260929 11:35:16.105945 15045 raft_consensus.cc:482] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.106539 15045 raft_consensus.cc:504] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.111078 15045 leader_election.cc:288] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.114274 15043 tablet_bootstrap.cc:492] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:16.114781 15043 ts_tablet_manager.cc:1397] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.049s user 0.012s sys 0.026s
I20260929 11:35:16.104197 15041 tablet_bootstrap.cc:654] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.116057 15042 raft_consensus.cc:348] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.117163 15042 raft_consensus.cc:374] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.116914 15043 raft_consensus.cc:348] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.117594 15042 raft_consensus.cc:729] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.117738 15043 raft_consensus.cc:374] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.118567 15043 raft_consensus.cc:729] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.119649 15042 consensus_queue.cc:260] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.121238 15043 consensus_queue.cc:260] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.123805 15043 ts_tablet_manager.cc:1428] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260929 11:35:16.125283 15043 tablet_bootstrap.cc:492] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.133314 15042 ts_tablet_manager.cc:1428] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.029s user 0.007s sys 0.003s
I20260929 11:35:16.134400 15042 tablet_bootstrap.cc:492] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.140836 15042 tablet_bootstrap.cc:654] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.145475 15043 tablet_bootstrap.cc:654] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:16.155537 14798 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:16.161978 15042 tablet_bootstrap.cc:492] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.162820 15042 ts_tablet_manager.cc:1397] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.029s user 0.016s sys 0.001s
I20260929 11:35:16.162623 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
W20260929 11:35:16.164594 14817 leader_election.cc:341] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.166914 15042 raft_consensus.cc:348] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.168129 15042 raft_consensus.cc:374] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.168601 15042 raft_consensus.cc:729] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.169648 15042 consensus_queue.cc:260] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.174126 15042 ts_tablet_manager.cc:1428] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260929 11:35:16.175132 15042 tablet_bootstrap.cc:492] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.181432 15042 tablet_bootstrap.cc:654] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.185351 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4a732e806e42b6a50a50e5cff2f84c" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
W20260929 11:35:16.189150 14965 leader_election.cc:341] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.200258 15043 tablet_bootstrap.cc:492] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:16.200805 15043 ts_tablet_manager.cc:1397] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.076s user 0.012s sys 0.019s
I20260929 11:35:16.201359 14927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4a732e806e42b6a50a50e5cff2f84c" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.201965 15042 tablet_bootstrap.cc:492] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.202472 15042 ts_tablet_manager.cc:1397] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.009s
I20260929 11:35:16.203337 15041 tablet_bootstrap.cc:492] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.203841 15041 ts_tablet_manager.cc:1397] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.107s user 0.042s sys 0.039s
I20260929 11:35:16.203577 15043 raft_consensus.cc:348] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.204424 15043 raft_consensus.cc:374] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.204782 15043 raft_consensus.cc:729] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.203074 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.205636 15043 consensus_queue.cc:260] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.205786 15042 raft_consensus.cc:348] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.206734 15042 raft_consensus.cc:374] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.206576 15041 raft_consensus.cc:348] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
W20260929 11:35:16.206912 14817 leader_election.cc:341] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.207134 15042 raft_consensus.cc:729] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.207355 15041 raft_consensus.cc:374] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.207538 14817 leader_election.cc:302] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4c0563b37a4f63a19afe4dd1d7bd11; no voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:16.207755 15041 raft_consensus.cc:729] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.208699 15045 raft_consensus.cc:2726] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:16.208815 15043 ts_tablet_manager.cc:1428] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260929 11:35:16.208371 15042 consensus_queue.cc:260] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.208508 15041 consensus_queue.cc:260] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.209903 15043 tablet_bootstrap.cc:492] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.210800 15041 ts_tablet_manager.cc:1428] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260929 11:35:16.210892 15042 ts_tablet_manager.cc:1428] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260929 11:35:16.211786 15041 tablet_bootstrap.cc:492] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:16.211957 15042 tablet_bootstrap.cc:492] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.213327 15048 raft_consensus.cc:482] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.213768 15048 raft_consensus.cc:504] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.216456 15048 leader_election.cc:288] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.218030 15041 tablet_bootstrap.cc:654] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.218531 15042 tablet_bootstrap.cc:654] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.224151 15052 raft_consensus.cc:482] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.224707 15052 raft_consensus.cc:504] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.226799 15052 leader_election.cc:288] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.228475 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863f8641fd5e43f59b2a37b31989144a" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
W20260929 11:35:16.230060 14965 leader_election.cc:341] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.207369 14927 raft_consensus.cc:2454] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 0.
I20260929 11:35:16.243515 15043 tablet_bootstrap.cc:654] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.255568 15045 raft_consensus.cc:482] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.256121 15045 raft_consensus.cc:504] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.258133 15045 leader_election.cc:288] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.260345 14927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.260486 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
I20260929 11:35:16.261075 14927 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 0.
I20260929 11:35:16.262377 14817 leader_election.cc:302] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
W20260929 11:35:16.263589 14817 leader_election.cc:341] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.264756 14966 leader_election.cc:302] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters: fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:16.265523 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
I20260929 11:35:16.266281 15052 raft_consensus.cc:2781] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.266746 15052 raft_consensus.cc:482] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.267156 15052 raft_consensus.cc:3037] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:16.267464 14892 leader_election.cc:341] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.268363 15045 raft_consensus.cc:2781] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.268847 15045 raft_consensus.cc:482] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.269270 15045 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.273415 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
I20260929 11:35:16.275038 14927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863f8641fd5e43f59b2a37b31989144a" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.275720 14927 raft_consensus.cc:2454] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 0.
I20260929 11:35:16.277161 14966 leader_election.cc:302] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters: fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:16.278430 15051 raft_consensus.cc:2781] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.278960 15051 raft_consensus.cc:482] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260929 11:35:16.279186 14891 leader_election.cc:341] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.279430 15051 raft_consensus.cc:3037] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.286592 15052 raft_consensus.cc:504] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.289692 15051 raft_consensus.cc:504] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.293413 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863f8641fd5e43f59b2a37b31989144a" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:16.295389 15043 tablet_bootstrap.cc:492] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
W20260929 11:35:16.295475 14965 leader_election.cc:341] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.279832 14891 leader_election.cc:302] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3; no voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:16.296216 15043 ts_tablet_manager.cc:1397] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.086s user 0.011s sys 0.013s
I20260929 11:35:16.297013 15048 raft_consensus.cc:2726] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:16.300886 15042 tablet_bootstrap.cc:492] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.301141 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4a732e806e42b6a50a50e5cff2f84c" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:16.301457 15042 ts_tablet_manager.cc:1397] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.090s user 0.023s sys 0.032s
W20260929 11:35:16.302630 14965 leader_election.cc:341] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.303226 15045 raft_consensus.cc:504] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.303835 14927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863f8641fd5e43f59b2a37b31989144a" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:16.304476 14927 raft_consensus.cc:3037] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.304540 15042 raft_consensus.cc:348] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.305472 15042 raft_consensus.cc:374] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.305830 15042 raft_consensus.cc:729] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.306690 15042 consensus_queue.cc:260] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.306975 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:16.307807 14926 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.314215 15052 leader_election.cc:288] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.314590 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4a732e806e42b6a50a50e5cff2f84c" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:16.315338 14925 raft_consensus.cc:3037] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.317230 14927 raft_consensus.cc:2454] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 1.
I20260929 11:35:16.318745 14966 leader_election.cc:302] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters: fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:16.319962 15052 raft_consensus.cc:2781] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.320660 15052 raft_consensus.cc:686] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:16.322506 14925 raft_consensus.cc:2454] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 1.
I20260929 11:35:16.321906 15052 consensus_queue.cc:237] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.323949 14966 leader_election.cc:302] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters: fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:16.324489 15051 leader_election.cc:288] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.325153 14926 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 1.
I20260929 11:35:16.326193 15051 raft_consensus.cc:2781] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.326265 14817 leader_election.cc:302] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:16.326754 15051 raft_consensus.cc:686] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:16.327646 15051 consensus_queue.cc:237] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.329563 15041 tablet_bootstrap.cc:492] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.329984 15043 raft_consensus.cc:348] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.330150 15041 ts_tablet_manager.cc:1397] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.119s user 0.044s sys 0.059s
I20260929 11:35:16.330588 15043 raft_consensus.cc:374] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.330925 15043 raft_consensus.cc:729] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.330780 15072 raft_consensus.cc:2781] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.333117 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:16.333761 15001 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.333410 15041 raft_consensus.cc:348] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.334162 15041 raft_consensus.cc:374] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.334466 15041 raft_consensus.cc:729] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.335287 15041 consensus_queue.cc:260] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.336251 15042 ts_tablet_manager.cc:1428] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.034s user 0.013s sys 0.016s
I20260929 11:35:16.337767 15042 tablet_bootstrap.cc:492] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.343540 15001 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 1.
I20260929 11:35:16.344712 15043 consensus_queue.cc:260] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.350279 15042 tablet_bootstrap.cc:654] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.354807 15070 raft_consensus.cc:482] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.355342 15070 raft_consensus.cc:504] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.355865 15045 leader_election.cc:288] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.358546 15070 leader_election.cc:288] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.358868 15043 ts_tablet_manager.cc:1428] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.062s user 0.004s sys 0.003s
I20260929 11:35:16.360280 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
I20260929 11:35:16.361032 14852 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 0.
I20260929 11:35:16.360491 15045 raft_consensus.cc:482] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.362146 15045 raft_consensus.cc:504] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.362937 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.363540 14926 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 0.
I20260929 11:35:16.364647 14966 leader_election.cc:302] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:16.364786 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
W20260929 11:35:16.366005 14817 leader_election.cc:341] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.366283 15070 raft_consensus.cc:2781] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.366631 15070 raft_consensus.cc:482] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.366958 15070 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.367659 15045 leader_election.cc:288] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.368454 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
W20260929 11:35:16.369686 14817 leader_election.cc:341] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.370122 14817 leader_election.cc:302] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd4c0563b37a4f63a19afe4dd1d7bd11; no voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:16.372215 15042 tablet_bootstrap.cc:492] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.374234 15070 raft_consensus.cc:504] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.375391 15042 ts_tablet_manager.cc:1397] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.037s user 0.016s sys 0.002s
I20260929 11:35:16.378199 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:16.378667 15043 tablet_bootstrap.cc:492] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.378845 14852 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.382445 15042 raft_consensus.cc:348] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.384481 15045 raft_consensus.cc:2726] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:16.386487 15072 raft_consensus.cc:686] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:16.387614 14852 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 1.
I20260929 11:35:16.387565 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:16.388262 14926 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.385576 15042 raft_consensus.cc:374] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.389319 15042 raft_consensus.cc:729] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.387773 15072 consensus_queue.cc:237] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.391131 15070 leader_election.cc:288] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.390383 14965 leader_election.cc:302] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:16.393152 15070 raft_consensus.cc:2781] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.393772 15070 raft_consensus.cc:686] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:16.394843 15070 consensus_queue.cc:237] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.396610 15042 consensus_queue.cc:260] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.399426 15042 ts_tablet_manager.cc:1428] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20260929 11:35:16.400539 15042 tablet_bootstrap.cc:492] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.402249 14926 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 1.
I20260929 11:35:16.403100 14750 catalog_manager.cc:5495] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 0 to 1, leader changed from <none> to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:16.406703 15043 tablet_bootstrap.cc:654] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.405531 14750 catalog_manager.cc:5495] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 0 to 1, leader changed from <none> to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:16.408224 15042 tablet_bootstrap.cc:654] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.411517 15041 ts_tablet_manager.cc:1428] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.081s user 0.020s sys 0.019s
I20260929 11:35:16.412599 15041 tablet_bootstrap.cc:492] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:16.416893 14748 catalog_manager.cc:5495] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:16.429612 15041 tablet_bootstrap.cc:654] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.439880 15042 tablet_bootstrap.cc:492] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.440940 15042 ts_tablet_manager.cc:1397] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.009s
I20260929 11:35:16.445492 15042 raft_consensus.cc:348] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.446545 15042 raft_consensus.cc:374] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.446910 15042 raft_consensus.cc:729] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.447849 15042 consensus_queue.cc:260] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.451527 15043 tablet_bootstrap.cc:492] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:16.452014 15043 ts_tablet_manager.cc:1397] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.074s user 0.014s sys 0.023s
I20260929 11:35:16.452510 15042 ts_tablet_manager.cc:1428] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.011s user 0.008s sys 0.001s
I20260929 11:35:16.453456 15042 tablet_bootstrap.cc:492] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.455184 15041 tablet_bootstrap.cc:492] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.454870 15043 raft_consensus.cc:348] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.455601 15043 raft_consensus.cc:374] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.455654 15041 ts_tablet_manager.cc:1397] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.043s user 0.021s sys 0.011s
I20260929 11:35:16.455963 15043 raft_consensus.cc:729] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.456707 15043 consensus_queue.cc:260] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.458748 15043 ts_tablet_manager.cc:1428] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260929 11:35:16.458491 15041 raft_consensus.cc:348] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.459254 15041 raft_consensus.cc:374] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.459530 15041 raft_consensus.cc:729] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.460274 15042 tablet_bootstrap.cc:654] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.460300 15041 consensus_queue.cc:260] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.459692 15043 tablet_bootstrap.cc:492] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.462788 15041 ts_tablet_manager.cc:1428] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260929 11:35:16.464241 15041 tablet_bootstrap.cc:492] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:16.464743 15072 raft_consensus.cc:482] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.465204 15072 raft_consensus.cc:504] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.467235 15072 leader_election.cc:288] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.467458 15043 tablet_bootstrap.cc:654] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.469424 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.469975 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
I20260929 11:35:16.470777 15001 raft_consensus.cc:2454] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 0.
W20260929 11:35:16.471306 14817 leader_election.cc:341] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.472270 14817 leader_election.cc:302] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters: 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:16.473119 15072 raft_consensus.cc:2781] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.473479 15072 raft_consensus.cc:482] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.473799 15072 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.475939 15041 tablet_bootstrap.cc:654] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.482312 15042 tablet_bootstrap.cc:492] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.484772 15042 ts_tablet_manager.cc:1397] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.008s
I20260929 11:35:16.483750 15072 raft_consensus.cc:504] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.487926 15042 raft_consensus.cc:348] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.488680 15042 raft_consensus.cc:374] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.489002 15042 raft_consensus.cc:729] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.489766 15042 consensus_queue.cc:260] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.490548 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
W20260929 11:35:16.491930 14817 leader_election.cc:341] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.492471 15042 ts_tablet_manager.cc:1428] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260929 11:35:16.496716 15072 leader_election.cc:288] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.496948 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:16.494907 15041 tablet_bootstrap.cc:492] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.501363 15001 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.501637 15041 ts_tablet_manager.cc:1397] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.008s
I20260929 11:35:16.502009 15042 tablet_bootstrap.cc:492] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.492188 14750 catalog_manager.cc:5495] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 0 to 1, leader changed from <none> to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:16.504292 15041 raft_consensus.cc:348] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.505126 15041 raft_consensus.cc:374] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.505452 15041 raft_consensus.cc:729] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.506197 15041 consensus_queue.cc:260] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.508054 15042 tablet_bootstrap.cc:654] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.508812 15041 ts_tablet_manager.cc:1428] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.007s user 0.001s sys 0.006s
I20260929 11:35:16.509822 15041 tablet_bootstrap.cc:492] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:16.510968 15001 raft_consensus.cc:2454] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 1.
I20260929 11:35:16.512189 14817 leader_election.cc:302] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters: 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:16.513108 15072 raft_consensus.cc:2781] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.513715 15072 raft_consensus.cc:686] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:16.514794 15072 consensus_queue.cc:237] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.518600 15043 tablet_bootstrap.cc:492] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:16.519143 15043 ts_tablet_manager.cc:1397] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.060s user 0.014s sys 0.005s
I20260929 11:35:16.519237 15042 tablet_bootstrap.cc:492] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.519780 15042 ts_tablet_manager.cc:1397] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.003s
I20260929 11:35:16.522116 15043 raft_consensus.cc:348] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.522256 15042 raft_consensus.cc:348] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.523131 15043 raft_consensus.cc:374] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.523257 15042 raft_consensus.cc:374] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.523579 15043 raft_consensus.cc:729] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.523734 15042 raft_consensus.cc:729] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.524520 15043 consensus_queue.cc:260] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.524772 15042 consensus_queue.cc:260] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.526741 15043 ts_tablet_manager.cc:1428] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260929 11:35:16.527688 15043 tablet_bootstrap.cc:492] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.523227 15041 tablet_bootstrap.cc:654] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.530434 15042 ts_tablet_manager.cc:1428] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.010s user 0.004s sys 0.004s
I20260929 11:35:16.531399 15070 raft_consensus.cc:482] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.531877 15070 raft_consensus.cc:504] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.533792 15043 tablet_bootstrap.cc:654] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.534336 15070 leader_election.cc:288] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.536124 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
I20260929 11:35:16.536439 15042 tablet_bootstrap.cc:492] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724: Bootstrap starting.
I20260929 11:35:16.537349 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.537997 14926 raft_consensus.cc:2454] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 0.
I20260929 11:35:16.539479 14966 leader_election.cc:302] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:16.539710 15048 raft_consensus.cc:482] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.540174 15048 raft_consensus.cc:504] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
W20260929 11:35:16.540830 14965 leader_election.cc:341] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.541676 15070 raft_consensus.cc:2781] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.542023 15070 raft_consensus.cc:482] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.542192 15048 leader_election.cc:288] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.542382 15070 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.543923 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03fc552d01a54c5587e1b1bf2f12a9b2" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
I20260929 11:35:16.545284 15072 raft_consensus.cc:482] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:35:16.545583 14892 leader_election.cc:341] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.545940 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03fc552d01a54c5587e1b1bf2f12a9b2" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
I20260929 11:35:16.545749 15072 raft_consensus.cc:504] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.546550 14852 raft_consensus.cc:2454] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 0.
I20260929 11:35:16.547773 14891 leader_election.cc:302] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters: 772cf848433a42958ebe6446e4623724
I20260929 11:35:16.548398 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.548866 15048 raft_consensus.cc:2781] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.549183 15048 raft_consensus.cc:482] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.549543 15048 raft_consensus.cc:3037] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:16.549721 14817 leader_election.cc:341] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.551710 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
I20260929 11:35:16.552381 15001 raft_consensus.cc:2454] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 0.
I20260929 11:35:16.553545 14817 leader_election.cc:302] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters: 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:16.554426 15072 leader_election.cc:288] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.554478 15075 raft_consensus.cc:2781] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.555038 15075 raft_consensus.cc:482] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.555435 15075 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.558369 15041 tablet_bootstrap.cc:492] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.558856 15041 ts_tablet_manager.cc:1397] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.004s
I20260929 11:35:16.561510 15041 raft_consensus.cc:348] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.562170 15041 raft_consensus.cc:374] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.562422 15041 raft_consensus.cc:729] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.563076 15041 consensus_queue.cc:260] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.564107 15048 raft_consensus.cc:504] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.565342 15041 ts_tablet_manager.cc:1428] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.006s user 0.006s sys 0.002s
I20260929 11:35:16.566226 15041 tablet_bootstrap.cc:492] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:16.566824 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03fc552d01a54c5587e1b1bf2f12a9b2" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:16.567389 14852 raft_consensus.cc:3037] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.554769 14748 catalog_manager.cc:5495] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:16.571359 15041 tablet_bootstrap.cc:654] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:16.573076 14878 tablet.cc:2369] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 11:35:16.577251 15070 raft_consensus.cc:504] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.578011 15075 raft_consensus.cc:504] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.580487 15075 leader_election.cc:288] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.542371 15042 tablet_bootstrap.cc:654] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.581647 14851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:16.582324 14851 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.582623 14852 raft_consensus.cc:2454] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 1.
I20260929 11:35:16.583750 14891 leader_election.cc:302] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:16.581244 15048 leader_election.cc:288] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.584618 15048 raft_consensus.cc:2781] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.585300 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:16.586870 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:16.587608 15001 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.591809 15043 tablet_bootstrap.cc:492] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:16.592564 15043 ts_tablet_manager.cc:1397] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.065s user 0.028s sys 0.011s
I20260929 11:35:16.596926 15000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03fc552d01a54c5587e1b1bf2f12a9b2" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724"
W20260929 11:35:16.593854 14817 leader_election.cc:341] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:16.603444 14892 leader_election.cc:341] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.585274 15048 raft_consensus.cc:686] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 LEADER]: Becoming Leader. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:16.608656 15052 raft_consensus.cc:482] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.609196 15048 consensus_queue.cc:237] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.609320 15052 raft_consensus.cc:504] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.611984 15052 leader_election.cc:288] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.612656 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
W20260929 11:35:16.615767 14965 leader_election.cc:341] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.616600 15043 raft_consensus.cc:348] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.617581 15043 raft_consensus.cc:374] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.617933 15043 raft_consensus.cc:729] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.618928 15001 raft_consensus.cc:2454] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 1.
I20260929 11:35:16.619027 14851 raft_consensus.cc:2454] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 1.
I20260929 11:35:16.618716 15043 consensus_queue.cc:260] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.621722 14817 leader_election.cc:302] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters: 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:16.623172 15042 tablet_bootstrap.cc:492] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724: No bootstrap required, opened a new log
I20260929 11:35:16.619817 15070 leader_election.cc:288] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.623858 15042 ts_tablet_manager.cc:1397] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724: Time spent bootstrapping tablet: real 0.088s user 0.011s sys 0.028s
I20260929 11:35:16.623299 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.624352 14965 leader_election.cc:302] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:16.624902 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:16.623461 15075 raft_consensus.cc:2781] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.625080 15070 raft_consensus.cc:2781] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.625480 14925 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.625581 15075 raft_consensus.cc:686] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:16.625655 15070 raft_consensus.cc:686] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:16.626091 15041 tablet_bootstrap.cc:492] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.626540 15041 ts_tablet_manager.cc:1397] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.060s user 0.019s sys 0.017s
W20260929 11:35:16.627230 14966 leader_election.cc:341] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.627662 14966 leader_election.cc:302] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772cf848433a42958ebe6446e4623724; no voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:16.628475 15052 raft_consensus.cc:2726] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:16.626516 15075 consensus_queue.cc:237] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.629550 15041 raft_consensus.cc:348] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.630244 15041 raft_consensus.cc:374] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.630488 15041 raft_consensus.cc:729] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.631331 15041 consensus_queue.cc:260] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:16.632628 14925 raft_consensus.cc:2454] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 1.
I20260929 11:35:16.626516 15070 consensus_queue.cc:237] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.633658 15041 ts_tablet_manager.cc:1428] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260929 11:35:16.634552 15041 tablet_bootstrap.cc:492] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11: Bootstrap starting.
I20260929 11:35:16.634111 14748 catalog_manager.cc:5495] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:16.638408 15043 ts_tablet_manager.cc:1428] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.045s user 0.006s sys 0.000s
I20260929 11:35:16.641868 15042 raft_consensus.cc:348] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.639411 15043 tablet_bootstrap.cc:492] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.642591 15042 raft_consensus.cc:374] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.644076 15042 raft_consensus.cc:729] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.644768 15042 consensus_queue.cc:260] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.645536 14749 catalog_manager.cc:5495] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:16.648729 15041 tablet_bootstrap.cc:654] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.650722 15043 tablet_bootstrap.cc:654] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.655035 15041 tablet_bootstrap.cc:492] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11: No bootstrap required, opened a new log
I20260929 11:35:16.655478 15041 ts_tablet_manager.cc:1397] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.002s
I20260929 11:35:16.655717 15042 ts_tablet_manager.cc:1428] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724: Time spent starting tablet: real 0.029s user 0.005s sys 0.000s
I20260929 11:35:16.658672 15043 tablet_bootstrap.cc:492] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:16.659071 15043 ts_tablet_manager.cc:1397] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.003s
I20260929 11:35:16.657840 15041 raft_consensus.cc:348] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.660902 15043 raft_consensus.cc:348] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.661410 15041 raft_consensus.cc:374] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.661593 15043 raft_consensus.cc:374] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.661772 15041 raft_consensus.cc:729] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.661939 15043 raft_consensus.cc:729] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.662479 15041 consensus_queue.cc:260] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.663196 15043 consensus_queue.cc:260] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.664299 15041 ts_tablet_manager.cc:1428] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11: Time spent starting tablet: real 0.009s user 0.004s sys 0.001s
I20260929 11:35:16.665345 15043 ts_tablet_manager.cc:1428] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260929 11:35:16.666476 15043 tablet_bootstrap.cc:492] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3: Bootstrap starting.
I20260929 11:35:16.665900 14748 catalog_manager.cc:5495] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 0 to 1, leader changed from <none> to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:16.669768 15070 raft_consensus.cc:482] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.670240 15070 raft_consensus.cc:504] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.672163 15070 leader_election.cc:288] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.673221 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.674754 14851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
I20260929 11:35:16.675499 15043 tablet_bootstrap.cc:654] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:16.675384 14851 raft_consensus.cc:2454] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 0.
I20260929 11:35:16.676913 14965 leader_election.cc:302] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:16.677752 15070 raft_consensus.cc:2781] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.678079 15070 raft_consensus.cc:482] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.678407 15070 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:16.680008 14966 leader_election.cc:341] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:16.682144 15043 tablet_bootstrap.cc:492] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3: No bootstrap required, opened a new log
I20260929 11:35:16.682570 15043 ts_tablet_manager.cc:1397] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.000s
I20260929 11:35:16.684964 15043 raft_consensus.cc:348] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.685678 15043 raft_consensus.cc:374] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:16.685408 15070 raft_consensus.cc:504] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.685950 15043 raft_consensus.cc:729] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Initialized, Role: FOLLOWER
I20260929 11:35:16.686565 15043 consensus_queue.cc:260] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.687342 15070 leader_election.cc:288] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.688534 15043 ts_tablet_manager.cc:1428] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260929 11:35:16.688355 14851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:16.688968 14851 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.692658 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:16.693177 14925 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.695058 14851 raft_consensus.cc:2454] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 1.
I20260929 11:35:16.696026 14965 leader_election.cc:302] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:16.696877 15070 raft_consensus.cc:2781] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.697359 15070 raft_consensus.cc:686] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:16.698191 15070 consensus_queue.cc:237] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.699323 14925 raft_consensus.cc:2454] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 1.
I20260929 11:35:16.707028 14749 catalog_manager.cc:5495] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 0 to 1, leader changed from <none> to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:16.775840 15070 consensus_queue.cc:1035] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:16.785898 14851 raft_consensus.cc:3037] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.794157 15070 consensus_queue.cc:1035] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:16.812287 14851 raft_consensus.cc:3037] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.812950 15095 raft_consensus.cc:482] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.813437 15095 raft_consensus.cc:504] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.815411 15095 leader_election.cc:288] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.816171 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
I20260929 11:35:16.816495 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
I20260929 11:35:16.817276 15001 raft_consensus.cc:2379] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in current term 1: Already voted for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in this term.
I20260929 11:35:16.818174 14892 leader_election.cc:302] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3; no voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:16.818975 15095 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.820217 15070 consensus_queue.cc:1035] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:16.825498 15095 raft_consensus.cc:2726] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:16.833133 15051 consensus_queue.cc:1035] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:16.834002 15052 raft_consensus.cc:482] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.834470 15052 raft_consensus.cc:504] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.836193 15052 leader_election.cc:288] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:16.837020 14851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03fc552d01a54c5587e1b1bf2f12a9b2" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" is_pre_election: true
I20260929 11:35:16.837924 14851 raft_consensus.cc:2379] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 772cf848433a42958ebe6446e4623724 in current term 1: Already voted for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in this term.
I20260929 11:35:16.838011 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03fc552d01a54c5587e1b1bf2f12a9b2" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.839454 14966 leader_election.cc:302] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772cf848433a42958ebe6446e4623724; no voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:16.840575 15052 raft_consensus.cc:3037] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.846249 15052 raft_consensus.cc:2726] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:16.901958 15075 raft_consensus.cc:482] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:16.902477 15075 raft_consensus.cc:504] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.904201 15075 leader_election.cc:288] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.905073 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" is_pre_election: true
I20260929 11:35:16.905295 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724" is_pre_election: true
I20260929 11:35:16.905624 14925 raft_consensus.cc:2454] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 0.
I20260929 11:35:16.905989 15001 raft_consensus.cc:2454] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 0.
I20260929 11:35:16.906661 14817 leader_election.cc:302] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:16.907473 15075 raft_consensus.cc:2781] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:16.907832 15075 raft_consensus.cc:482] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:16.908156 15075 raft_consensus.cc:3037] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.910580 15052 consensus_queue.cc:1035] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:16.914238 15075 raft_consensus.cc:504] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.916216 15075 leader_election.cc:288] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:16.917173 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:16.917259 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:16.917871 14925 raft_consensus.cc:3037] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.917927 15001 raft_consensus.cc:3037] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.924742 15071 consensus_queue.cc:1035] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:16.925113 14925 raft_consensus.cc:2454] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 1.
I20260929 11:35:16.925890 15001 raft_consensus.cc:2454] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 1.
I20260929 11:35:16.926178 14817 leader_election.cc:302] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:16.927024 15075 raft_consensus.cc:2781] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:16.927485 15075 raft_consensus.cc:686] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:16.928263 15075 consensus_queue.cc:237] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:16.937620 14749 catalog_manager.cc:5495] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:16.947688 15075 consensus_queue.cc:1035] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:16.959627 14925 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:16.967661 15072 consensus_queue.cc:1035] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:16.969841 15075 consensus_queue.cc:1035] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:16.970670 15115 consensus_queue.cc:1035] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:16.997314 15095 consensus_queue.cc:1035] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.008839 15095 consensus_queue.cc:1035] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.107635 15001 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8f4a732e806e42b6a50a50e5cff2f84c"
dest_uuid: "772cf848433a42958ebe6446e4623724"
mode: GRACEFUL
new_leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:46258
I20260929 11:35:17.108278 15001 raft_consensus.cc:595] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Received request to transfer leadership to TS fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:17.115198 15001 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630"
dest_uuid: "772cf848433a42958ebe6446e4623724"
mode: GRACEFUL
new_leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:46258
I20260929 11:35:17.115743 15001 raft_consensus.cc:595] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Received request to transfer leadership to TS fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:17.120061 15001 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9"
dest_uuid: "772cf848433a42958ebe6446e4623724"
mode: GRACEFUL
new_leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:46258
I20260929 11:35:17.120646 15001 raft_consensus.cc:595] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Received request to transfer leadership to TS fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:17.137326 14851 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
mode: GRACEFUL
new_leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:43768
I20260929 11:35:17.137902 14851 raft_consensus.cc:595] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Received request to transfer leadership to TS 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:17.142786 15001 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337"
dest_uuid: "772cf848433a42958ebe6446e4623724"
mode: GRACEFUL
new_leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:46258
I20260929 11:35:17.143329 15001 raft_consensus.cc:595] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Received request to transfer leadership to TS 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:17.147964 14851 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
mode: GRACEFUL
new_leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:43768
I20260929 11:35:17.148494 14851 raft_consensus.cc:595] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Received request to transfer leadership to TS 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:17.169855 15052 consensus_queue.cc:1035] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.173214 15075 consensus_queue.cc:1035] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.176622 15071 raft_consensus.cc:979] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724: : Instructing follower fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:17.177032 15071 raft_consensus.cc:1067] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Signalling peer fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:17.183176 15072 consensus_queue.cc:1035] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.184944 15071 consensus_queue.cc:1035] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.184983 14851 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:43746
I20260929 11:35:17.186676 14851 raft_consensus.cc:482] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:17.187057 14851 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.201782 14851 raft_consensus.cc:504] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.203687 14851 leader_election.cc:288] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 2 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:17.204228 15071 consensus_queue.cc:1035] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.205080 14927 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:17.205138 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:17.205711 14927 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.205837 15001 raft_consensus.cc:3032] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:17.206220 15001 raft_consensus.cc:729] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:17.210831 15001 consensus_queue.cc:260] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.212215 15001 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.212355 14927 raft_consensus.cc:2454] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 2.
I20260929 11:35:17.213553 14817 leader_election.cc:302] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:17.214409 15072 raft_consensus.cc:2781] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:17.215054 15072 raft_consensus.cc:686] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:17.215857 15072 consensus_queue.cc:237] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.219409 15001 raft_consensus.cc:2454] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 2.
I20260929 11:35:17.225368 15070 raft_consensus.cc:979] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724: : Instructing follower 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:17.225831 15070 raft_consensus.cc:1067] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Signalling peer 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:17.225740 14749 catalog_manager.cc:5495] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 1 to 2, leader changed from 772cf848433a42958ebe6446e4623724 (127.13.221.195) to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:17.229754 15071 consensus_queue.cc:1035] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.230309 14927 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337"
dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:54800
I20260929 11:35:17.230866 14927 raft_consensus.cc:482] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:17.231220 14927 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.238020 14927 raft_consensus.cc:504] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.240999 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:17.243108 14924 raft_consensus.cc:1226] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Rejecting Update request from peer 772cf848433a42958ebe6446e4623724 for earlier term 1. Current term is 2. Ops: []
I20260929 11:35:17.243839 14927 leader_election.cc:288] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 2 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:17.245153 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:17.245847 15001 raft_consensus.cc:3032] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:17.246192 15001 raft_consensus.cc:729] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:17.247121 15001 consensus_queue.cc:260] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.247980 15070 consensus_queue.cc:1046] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.249114 15001 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.255848 15001 raft_consensus.cc:2454] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 2.
I20260929 11:35:17.256865 14892 leader_election.cc:302] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters: fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:17.257573 15120 raft_consensus.cc:2781] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:17.257977 15120 raft_consensus.cc:686] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Becoming Leader. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:17.258725 15120 consensus_queue.cc:237] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.264605 14747 catalog_manager.cc:5495] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 reported cstate change: term changed from 1 to 2, leader changed from 772cf848433a42958ebe6446e4623724 (127.13.221.195) to 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:17.300173 15052 raft_consensus.cc:979] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724: : Instructing follower fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:17.300693 15071 raft_consensus.cc:1067] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Signalling peer fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:17.302117 14851 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8f4a732e806e42b6a50a50e5cff2f84c"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:43746
I20260929 11:35:17.302631 14851 raft_consensus.cc:482] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:17.302922 14851 raft_consensus.cc:3037] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.308198 14851 raft_consensus.cc:504] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:17.309760 14851 leader_election.cc:288] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 2 election: Requested vote from peers 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:17.310742 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4a732e806e42b6a50a50e5cff2f84c" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:17.310930 14924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f4a732e806e42b6a50a50e5cff2f84c" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:17.311357 15001 raft_consensus.cc:3032] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:17.311422 14924 raft_consensus.cc:3037] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.311764 15001 raft_consensus.cc:729] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:17.312574 15001 consensus_queue.cc:260] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:17.313820 15001 raft_consensus.cc:3037] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.318338 14924 raft_consensus.cc:2454] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 2.
I20260929 11:35:17.319484 14817 leader_election.cc:302] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:17.320294 15001 raft_consensus.cc:2454] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 2.
I20260929 11:35:17.320418 15072 raft_consensus.cc:2781] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:17.320940 15072 raft_consensus.cc:686] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:17.321710 15072 consensus_queue.cc:237] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } }
I20260929 11:35:17.324738 15072 consensus_queue.cc:1035] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.328629 14747 catalog_manager.cc:5495] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 1 to 2, leader changed from 772cf848433a42958ebe6446e4623724 (127.13.221.195) to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:17.341220 15072 consensus_queue.cc:1035] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:17.364434 15075 raft_consensus.cc:979] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11: : Instructing follower 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:17.364876 15072 raft_consensus.cc:1067] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Signalling peer 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:17.366174 14924 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f"
dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:54814
I20260929 11:35:17.366652 14924 raft_consensus.cc:482] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:17.366984 14924 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.371403 14924 raft_consensus.cc:504] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.372865 14924 leader_election.cc:288] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 2 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:17.373768 14851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:17.373903 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:17.374293 14851 raft_consensus.cc:3032] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:17.374552 15001 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.374653 14851 raft_consensus.cc:729] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:17.375450 14851 consensus_queue.cc:260] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.376681 14851 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.377557 15115 raft_consensus.cc:979] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11: : Instructing follower 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:17.377962 15115 raft_consensus.cc:1067] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Signalling peer 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:17.379846 14924 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c"
dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:54814
I20260929 11:35:17.380467 14924 raft_consensus.cc:482] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:17.380833 14924 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.381441 15001 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 2.
I20260929 11:35:17.382670 14892 leader_election.cc:302] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:17.383033 14851 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 2.
I20260929 11:35:17.383476 15120 raft_consensus.cc:2781] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:17.383973 15120 raft_consensus.cc:686] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Becoming Leader. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:17.384694 15120 consensus_queue.cc:237] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.386489 14924 raft_consensus.cc:504] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.388295 14924 leader_election.cc:288] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 2 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:17.389183 14851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:17.389369 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:17.389905 15001 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.389907 14851 raft_consensus.cc:3032] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:17.390395 14851 raft_consensus.cc:729] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:17.390781 14749 catalog_manager.cc:5495] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 reported cstate change: term changed from 1 to 2, leader changed from fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193) to 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:17.391160 14851 consensus_queue.cc:260] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.392422 14851 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.396716 15001 raft_consensus.cc:2454] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 2.
I20260929 11:35:17.397982 14892 leader_election.cc:302] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:17.398764 15120 raft_consensus.cc:2781] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:17.399029 14851 raft_consensus.cc:2454] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 2.
I20260929 11:35:17.399179 15120 raft_consensus.cc:686] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Becoming Leader. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:17.400060 15120 consensus_queue.cc:237] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.405874 14749 catalog_manager.cc:5495] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 reported cstate change: term changed from 1 to 2, leader changed from fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193) to 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:17.514283 15052 raft_consensus.cc:979] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724: : Instructing follower fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:17.514778 15070 raft_consensus.cc:1067] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Signalling peer fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:17.516140 14851 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:43746
I20260929 11:35:17.516736 14851 raft_consensus.cc:482] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:17.517119 14851 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.522418 14851 raft_consensus.cc:504] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.523819 14851 leader_election.cc:288] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 2 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:17.524673 14924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:17.524858 15001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:17.525324 14924 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.525375 15001 raft_consensus.cc:3032] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:17.525931 15001 raft_consensus.cc:729] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:17.526718 15001 consensus_queue.cc:260] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.527941 15001 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.532634 14924 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 2.
I20260929 11:35:17.533857 14817 leader_election.cc:302] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:17.534418 15001 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 2.
I20260929 11:35:17.534822 15072 raft_consensus.cc:2781] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:17.535282 15072 raft_consensus.cc:686] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:17.536113 15072 consensus_queue.cc:237] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:17.542527 14749 catalog_manager.cc:5495] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 1 to 2, leader changed from 772cf848433a42958ebe6446e4623724 (127.13.221.195) to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:17.640995 14851 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:17.646099 14851 raft_consensus.cc:1261] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.647338 15133 consensus_queue.cc:1035] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.656592 15001 raft_consensus.cc:1261] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.659260 15001 raft_consensus.cc:1261] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.659528 15133 consensus_queue.cc:1035] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.660835 15072 consensus_queue.cc:1035] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.669948 14924 raft_consensus.cc:1261] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.671790 15072 consensus_queue.cc:1035] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.790757 15001 raft_consensus.cc:1261] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.791975 15133 consensus_queue.cc:1035] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.799525 14852 raft_consensus.cc:1261] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.801062 15120 consensus_queue.cc:1035] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.862618 15001 raft_consensus.cc:1261] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.863837 15072 consensus_queue.cc:1035] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.872336 14924 raft_consensus.cc:1261] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.873396 15000 raft_consensus.cc:1261] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.874428 15135 consensus_queue.cc:1035] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.874761 15120 consensus_queue.cc:1035] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:17.884435 14852 raft_consensus.cc:1261] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:17.885927 15048 consensus_queue.cc:1035] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:18.009768 14924 raft_consensus.cc:1261] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:18.010991 15135 consensus_queue.cc:1035] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:18.020779 15001 raft_consensus.cc:1261] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:18.022305 15115 consensus_queue.cc:1035] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:20.751175 14199 auto_leader_rebalancer-test.cc:339] The leader distribution is
I20260929 11:35:20.751878 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:20.774392 14852 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
mode: GRACEFUL
new_leader_uuid: "772cf848433a42958ebe6446e4623724"
from {username='slave'} at 127.0.0.1:49056
I20260929 11:35:20.774891 14852 raft_consensus.cc:595] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Received request to transfer leadership to TS 772cf848433a42958ebe6446e4623724
I20260929 11:35:20.777312 14852 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
mode: GRACEFUL
new_leader_uuid: "772cf848433a42958ebe6446e4623724"
from {username='slave'} at 127.0.0.1:49056
I20260929 11:35:20.777793 14852 raft_consensus.cc:595] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Received request to transfer leadership to TS 772cf848433a42958ebe6446e4623724
I20260929 11:35:20.778621 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260929 11:35:20.779043 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260929 11:35:20.862565 15022 debug-util.cc:398] Leaking SignalData structure 0x7b08001d6b60 after lost signal to thread 14202
W20260929 11:35:20.863384 15022 debug-util.cc:398] Leaking SignalData structure 0x7b0800194d40 after lost signal to thread 14784
W20260929 11:35:20.864794 15022 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6000 after lost signal to thread 14951
W20260929 11:35:20.865538 15022 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1220 after lost signal to thread 15025
I20260929 11:35:20.976976 15144 raft_consensus.cc:979] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11: : Instructing follower 772cf848433a42958ebe6446e4623724 to start an election
I20260929 11:35:20.977499 15147 raft_consensus.cc:1067] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Signalling peer 772cf848433a42958ebe6446e4623724 to start an election
I20260929 11:35:20.979269 14999 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa"
dest_uuid: "772cf848433a42958ebe6446e4623724"
from {username='slave'} at 127.0.0.1:46244
I20260929 11:35:20.979785 14999 raft_consensus.cc:482] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:20.980094 14999 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:20.984880 14999 raft_consensus.cc:504] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:20.986532 14999 leader_election.cc:288] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 2 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:20.987365 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:20.987649 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:20.987977 14852 raft_consensus.cc:3032] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:20.988159 14925 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:20.988381 14852 raft_consensus.cc:729] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:20.989177 14852 consensus_queue.cc:260] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:20.990410 14852 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:20.994930 14925 raft_consensus.cc:2454] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 2.
I20260929 11:35:20.996222 14966 leader_election.cc:302] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:20.996989 14852 raft_consensus.cc:2454] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 2.
I20260929 11:35:20.997107 15139 raft_consensus.cc:2781] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:20.998544 15139 raft_consensus.cc:686] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 2 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:20.999478 15139 consensus_queue.cc:237] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:21.012595 14750 catalog_manager.cc:5495] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 1 to 2, leader changed from fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193) to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 2 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:21.236063 15144 raft_consensus.cc:979] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11: : Instructing follower 772cf848433a42958ebe6446e4623724 to start an election
I20260929 11:35:21.236588 15147 raft_consensus.cc:1067] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Signalling peer 772cf848433a42958ebe6446e4623724 to start an election
I20260929 11:35:21.238045 14999 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9"
dest_uuid: "772cf848433a42958ebe6446e4623724"
from {username='slave'} at 127.0.0.1:46244
I20260929 11:35:21.238654 14999 raft_consensus.cc:482] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:21.239017 14999 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:21.246683 14999 raft_consensus.cc:504] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:21.248853 14999 leader_election.cc:288] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 3 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:21.249962 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:21.250288 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:21.250571 14925 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:21.250931 14852 raft_consensus.cc:3032] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:21.251273 14852 raft_consensus.cc:729] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:21.252079 14852 consensus_queue.cc:260] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:21.253445 14852 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:21.255511 14925 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 3.
I20260929 11:35:21.256505 14966 leader_election.cc:302] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:21.257202 15139 raft_consensus.cc:2781] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:21.257663 15139 raft_consensus.cc:686] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 3 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:21.258424 15139 consensus_queue.cc:237] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:21.260365 14852 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 3.
I20260929 11:35:21.266022 14750 catalog_manager.cc:5495] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 2 to 3, leader changed from fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193) to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 3 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:21.489748 14852 raft_consensus.cc:1261] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Refusing update from remote peer 772cf848433a42958ebe6446e4623724: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:21.490962 15139 consensus_queue.cc:1035] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:21.501683 14925 raft_consensus.cc:1261] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Refusing update from remote peer 772cf848433a42958ebe6446e4623724: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:21.505424 15148 consensus_queue.cc:1035] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:21.690434 14925 raft_consensus.cc:1261] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Refusing update from remote peer 772cf848433a42958ebe6446e4623724: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:21.691761 15139 consensus_queue.cc:1035] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:21.703787 14852 raft_consensus.cc:1261] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Refusing update from remote peer 772cf848433a42958ebe6446e4623724: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:21.705283 15139 consensus_queue.cc:1035] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:21.779908 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:21.785175 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:21.785624 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:22.786535 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:22.792570 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:22.793109 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:23.793946 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:23.799315 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:23.799765 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:24.800945 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:24.806926 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:24.807359 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:25.808255 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:25.813349 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:25.813767 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:26.814627 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:26.820575 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:26.820990 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:27.821846 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:27.827237 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:27.827656 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:28.828527 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:28.834005 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:28.834447 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:29.835240 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:29.840849 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:29.841282 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:30.870299 14199 auto_leader_rebalancer-test.cc:358] The leader distribution is
I20260929 11:35:30.881695 15000 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9"
dest_uuid: "772cf848433a42958ebe6446e4623724"
mode: GRACEFUL
new_leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:46258
I20260929 11:35:30.882522 15000 raft_consensus.cc:595] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 3 LEADER]: Received request to transfer leadership to TS fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:30.887422 15000 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa"
dest_uuid: "772cf848433a42958ebe6446e4623724"
mode: GRACEFUL
new_leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:46258
I20260929 11:35:30.888085 15000 raft_consensus.cc:595] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 2 LEADER]: Received request to transfer leadership to TS fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:30.910192 14925 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c"
dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
mode: GRACEFUL
new_leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:56572
I20260929 11:35:30.910856 14925 raft_consensus.cc:595] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Received request to transfer leadership to TS fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:30.912290 15173 raft_consensus.cc:979] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724: : Instructing follower fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:30.913028 15166 raft_consensus.cc:1067] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 3 LEADER]: Signalling peer fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:30.914698 14852 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:43746
I20260929 11:35:30.915215 14852 raft_consensus.cc:482] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:30.915655 14852 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:30.915979 14925 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337"
dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
mode: GRACEFUL
new_leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:56572
I20260929 11:35:30.916486 14925 raft_consensus.cc:595] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Received request to transfer leadership to TS fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:30.921675 14925 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f"
dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
mode: GRACEFUL
new_leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:56572
I20260929 11:35:30.922145 14925 raft_consensus.cc:595] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Received request to transfer leadership to TS fd4c0563b37a4f63a19afe4dd1d7bd11
I20260929 11:35:30.923159 14852 raft_consensus.cc:504] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:30.925257 14852 leader_election.cc:288] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 4 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:30.926403 15000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:30.926409 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f8bafaf01974fa2819e59aa962defa9" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:30.927335 14925 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:30.927289 15000 raft_consensus.cc:3032] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:35:30.927757 15000 raft_consensus.cc:729] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:30.928692 15000 consensus_queue.cc:260] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:30.930091 15000 raft_consensus.cc:3037] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:30.934695 14925 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 4.
I20260929 11:35:30.935920 14817 leader_election.cc:302] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:30.936834 15170 raft_consensus.cc:2781] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:35:30.937445 15000 raft_consensus.cc:2454] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 4.
I20260929 11:35:30.937817 15170 raft_consensus.cc:686] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:30.938675 15170 consensus_queue.cc:237] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:30.947940 15165 raft_consensus.cc:979] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3: : Instructing follower fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:30.947468 14750 catalog_manager.cc:5495] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 3 to 4, leader changed from 772cf848433a42958ebe6446e4623724 (127.13.221.195) to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 4 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:30.948553 15176 raft_consensus.cc:1067] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Signalling peer fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:30.950140 14852 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:43756
I20260929 11:35:30.950636 14852 raft_consensus.cc:482] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:30.950942 14852 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:30.956254 14852 raft_consensus.cc:504] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:30.958112 14852 leader_election.cc:288] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 3 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:30.959007 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:30.959596 14925 raft_consensus.cc:3032] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:30.959820 15000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:30.959908 14925 raft_consensus.cc:729] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:30.960512 15000 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:30.960995 14925 consensus_queue.cc:260] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:30.962255 14925 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:30.965932 15000 raft_consensus.cc:2454] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 3.
I20260929 11:35:30.966977 14817 leader_election.cc:302] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:30.967001 14925 raft_consensus.cc:2454] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 3.
I20260929 11:35:30.967716 15170 raft_consensus.cc:2781] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:30.968294 15170 raft_consensus.cc:686] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:30.969221 15170 consensus_queue.cc:237] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:30.975487 14750 catalog_manager.cc:5495] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 2 to 3, leader changed from 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194) to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:31.082278 15165 raft_consensus.cc:979] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3: : Instructing follower fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:31.082695 15176 raft_consensus.cc:1067] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Signalling peer fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:31.084026 14852 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:43756
I20260929 11:35:31.084489 14852 raft_consensus.cc:482] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:31.084721 14852 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.088614 14852 raft_consensus.cc:504] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.089824 14852 leader_election.cc:288] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 3 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:31.090674 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:31.090952 15000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:31.091240 14925 raft_consensus.cc:3032] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:31.091437 15000 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.091595 14925 raft_consensus.cc:729] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:31.092404 14925 consensus_queue.cc:260] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.093600 14925 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.098950 15000 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 3.
I20260929 11:35:31.099593 14925 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 3.
I20260929 11:35:31.100001 14817 leader_election.cc:302] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:31.100816 15170 raft_consensus.cc:2781] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:31.101262 15170 raft_consensus.cc:686] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:31.102087 15170 consensus_queue.cc:237] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.109321 14750 catalog_manager.cc:5495] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 2 to 3, leader changed from 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194) to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:31.225629 15165 raft_consensus.cc:979] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3: : Instructing follower fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:31.226071 15176 raft_consensus.cc:1067] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Signalling peer fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:31.227592 14852 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:43756
I20260929 11:35:31.228066 14852 raft_consensus.cc:482] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:31.228317 14852 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.232833 14852 raft_consensus.cc:504] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.234722 14852 leader_election.cc:288] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 3 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:31.235553 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:31.235687 15000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3dc7ce7d894cb2ac31f3501adef337" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:31.236137 14925 raft_consensus.cc:3032] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:31.236137 15000 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.236635 14925 raft_consensus.cc:729] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:31.237721 14925 consensus_queue.cc:260] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.238935 14925 raft_consensus.cc:3037] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.241606 15000 raft_consensus.cc:2454] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 3.
I20260929 11:35:31.242426 14817 leader_election.cc:302] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:31.243057 15170 raft_consensus.cc:2781] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:31.243523 15170 raft_consensus.cc:686] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:31.243693 14925 raft_consensus.cc:2454] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 3.
I20260929 11:35:31.244427 15170 consensus_queue.cc:237] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.251170 14750 catalog_manager.cc:5495] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 2 to 3, leader changed from 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194) to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:31.291059 15173 raft_consensus.cc:979] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724: : Instructing follower fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:31.291507 15166 raft_consensus.cc:1067] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 2 LEADER]: Signalling peer fd4c0563b37a4f63a19afe4dd1d7bd11 to start an election
I20260929 11:35:31.292861 14852 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
from {username='slave'} at 127.0.0.1:43746
I20260929 11:35:31.293241 14852 raft_consensus.cc:482] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:31.293473 14852 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.297626 14852 raft_consensus.cc:504] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.298938 14852 leader_election.cc:288] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 3 election: Requested vote from peers 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:31.299573 14925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:31.299806 15000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44d0aeb5caf415c92faf30e5b5eaffa" candidate_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:31.300113 14925 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.300269 15000 raft_consensus.cc:3032] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:31.300613 15000 raft_consensus.cc:729] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:31.301297 15000 consensus_queue.cc:260] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.302357 15000 raft_consensus.cc:3037] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:31.306183 14925 raft_consensus.cc:2454] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 3.
I20260929 11:35:31.307384 14817 leader_election.cc:302] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84e586c04f3849e89bfbb1ff24fd3dd3, fd4c0563b37a4f63a19afe4dd1d7bd11; no voters:
I20260929 11:35:31.308107 15170 raft_consensus.cc:2781] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:31.308393 15000 raft_consensus.cc:2454] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd4c0563b37a4f63a19afe4dd1d7bd11 in term 3.
I20260929 11:35:31.308645 15170 raft_consensus.cc:686] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Becoming Leader. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:31.309495 15170 consensus_queue.cc:237] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:31.316440 14750 catalog_manager.cc:5495] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 reported cstate change: term changed from 2 to 3, leader changed from 772cf848433a42958ebe6446e4623724 (127.13.221.195) to fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:31.381625 15000 raft_consensus.cc:1261] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:35:31.382795 15170 consensus_queue.cc:1035] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:35:31.392845 14925 raft_consensus.cc:1261] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:35:31.395287 15188 consensus_queue.cc:1035] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:35:31.412725 14925 raft_consensus.cc:1261] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:31.413946 15174 consensus_queue.cc:1035] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:31.422209 15000 raft_consensus.cc:1261] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:31.423671 15174 consensus_queue.cc:1035] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:31.494374 14925 raft_consensus.cc:1261] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:31.495719 15174 consensus_queue.cc:1035] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:31.507493 15000 raft_consensus.cc:1261] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:31.510051 15194 consensus_queue.cc:1035] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:35:31.703583 14925 raft_consensus.cc:1261] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:31.704883 15188 consensus_queue.cc:1035] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:31.713501 15000 raft_consensus.cc:1261] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:31.714701 15174 consensus_queue.cc:1035] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:31.812165 14925 raft_consensus.cc:1261] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:31.813386 15188 consensus_queue.cc:1035] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:31.821681 15000 raft_consensus.cc:1261] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Refusing update from remote peer fd4c0563b37a4f63a19afe4dd1d7bd11: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:31.823496 15188 consensus_queue.cc:1035] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:33.986261 14199 auto_leader_rebalancer-test.cc:373] The leader distribution is
I20260929 11:35:33.987047 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:33.995561 14852 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
mode: GRACEFUL
new_leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:49056
I20260929 11:35:33.996398 14852 raft_consensus.cc:595] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Received request to transfer leadership to TS 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:33.998801 14852 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
mode: GRACEFUL
new_leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:49056
I20260929 11:35:33.999266 14852 raft_consensus.cc:595] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Received request to transfer leadership to TS 84e586c04f3849e89bfbb1ff24fd3dd3
I20260929 11:35:34.001946 14852 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
mode: GRACEFUL
new_leader_uuid: "772cf848433a42958ebe6446e4623724"
from {username='slave'} at 127.0.0.1:49056
I20260929 11:35:34.002398 14852 raft_consensus.cc:595] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Received request to transfer leadership to TS 772cf848433a42958ebe6446e4623724
I20260929 11:35:34.004742 14852 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f"
dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
mode: GRACEFUL
new_leader_uuid: "772cf848433a42958ebe6446e4623724"
from {username='slave'} at 127.0.0.1:49056
I20260929 11:35:34.005175 14852 raft_consensus.cc:595] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Received request to transfer leadership to TS 772cf848433a42958ebe6446e4623724
I20260929 11:35:34.006054 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260929 11:35:34.006490 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:34.015436 15194 raft_consensus.cc:979] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11: : Instructing follower 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:34.016089 15202 raft_consensus.cc:1067] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Signalling peer 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:34.017788 14926 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630"
dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:54814
I20260929 11:35:34.018323 14926 raft_consensus.cc:482] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:34.018612 14926 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:34.024607 14926 raft_consensus.cc:504] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.026959 14926 leader_election.cc:288] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 3 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:34.028151 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:34.028244 15000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49235c43d61f495297d42cfcbb5d7630" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:34.028980 14852 raft_consensus.cc:3032] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:35:34.029124 15000 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:34.029254 14852 raft_consensus.cc:729] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:34.030134 14852 consensus_queue.cc:260] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.031407 14852 raft_consensus.cc:3037] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:35:34.034775 15000 raft_consensus.cc:2454] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 3.
I20260929 11:35:34.035910 14892 leader_election.cc:302] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:34.036890 15176 raft_consensus.cc:2781] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:35:34.036943 14852 raft_consensus.cc:2454] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 3.
I20260929 11:35:34.038331 15176 raft_consensus.cc:686] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 LEADER]: Becoming Leader. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:34.039342 15176 consensus_queue.cc:237] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.047536 14749 catalog_manager.cc:5495] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 reported cstate change: term changed from 2 to 3, leader changed from fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193) to 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194). New cstate: current_term: 3 leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:34.055117 15194 raft_consensus.cc:979] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11: : Instructing follower 772cf848433a42958ebe6446e4623724 to start an election
I20260929 11:35:34.055663 15202 raft_consensus.cc:1067] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Signalling peer 772cf848433a42958ebe6446e4623724 to start an election
I20260929 11:35:34.057222 15000 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81"
dest_uuid: "772cf848433a42958ebe6446e4623724"
from {username='slave'} at 127.0.0.1:46244
I20260929 11:35:34.057775 15000 raft_consensus.cc:482] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:34.058125 15000 raft_consensus.cc:3037] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:34.063257 15000 raft_consensus.cc:504] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.065039 15000 leader_election.cc:288] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 2 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:34.065979 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:34.066037 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab678679af24b559ffde00ab2cddc81" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:34.066576 14852 raft_consensus.cc:3032] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:34.066629 14926 raft_consensus.cc:3037] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:34.066876 14852 raft_consensus.cc:729] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:34.067514 14852 consensus_queue.cc:260] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.068482 14852 raft_consensus.cc:3037] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:34.071565 14926 raft_consensus.cc:2454] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 2.
I20260929 11:35:34.072758 14966 leader_election.cc:302] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:34.072924 14852 raft_consensus.cc:2454] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 2.
I20260929 11:35:34.073643 15166 raft_consensus.cc:2781] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:34.074707 15166 raft_consensus.cc:686] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 2 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:34.075505 15166 consensus_queue.cc:237] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.084383 14749 catalog_manager.cc:5495] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 1 to 2, leader changed from fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193) to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 2 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:34.116479 15202 raft_consensus.cc:979] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11: : Instructing follower 772cf848433a42958ebe6446e4623724 to start an election
I20260929 11:35:34.116915 15194 raft_consensus.cc:1067] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Signalling peer 772cf848433a42958ebe6446e4623724 to start an election
I20260929 11:35:34.118202 14999 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f"
dest_uuid: "772cf848433a42958ebe6446e4623724"
from {username='slave'} at 127.0.0.1:46244
I20260929 11:35:34.118623 14999 raft_consensus.cc:482] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:34.118851 14999 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:34.123656 14999 raft_consensus.cc:504] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.125334 14999 leader_election.cc:288] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 4 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057)
I20260929 11:35:34.126128 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:34.126461 14926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc7b64fd5dc148b78df202c4b688927f" candidate_uuid: "772cf848433a42958ebe6446e4623724" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
I20260929 11:35:34.126721 14852 raft_consensus.cc:3032] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:35:34.127048 14852 raft_consensus.cc:729] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:34.127152 14926 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:34.127743 14852 consensus_queue.cc:260] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.128768 14852 raft_consensus.cc:3037] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:34.132252 14926 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 4.
I20260929 11:35:34.132786 14852 raft_consensus.cc:2454] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772cf848433a42958ebe6446e4623724 in term 4.
I20260929 11:35:34.133360 14966 leader_election.cc:302] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:34.134070 15166 raft_consensus.cc:2781] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:35:34.134547 15166 raft_consensus.cc:686] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 4 LEADER]: Becoming Leader. State: Replica: 772cf848433a42958ebe6446e4623724, State: Running, Role: LEADER
I20260929 11:35:34.135366 15166 consensus_queue.cc:237] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.142475 14749 catalog_manager.cc:5495] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 reported cstate change: term changed from 3 to 4, leader changed from fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193) to 772cf848433a42958ebe6446e4623724 (127.13.221.195). New cstate: current_term: 4 leader_uuid: "772cf848433a42958ebe6446e4623724" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:34.261723 15202 raft_consensus.cc:979] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11: : Instructing follower 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:34.262159 15194 raft_consensus.cc:1067] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Signalling peer 84e586c04f3849e89bfbb1ff24fd3dd3 to start an election
I20260929 11:35:34.263486 14926 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c"
dest_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3"
from {username='slave'} at 127.0.0.1:54814
I20260929 11:35:34.263984 14926 raft_consensus.cc:482] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:35:34.264420 14926 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:34.268981 14926 raft_consensus.cc:504] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.270541 14926 leader_election.cc:288] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 4 election: Requested vote from peers fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605), 772cf848433a42958ebe6446e4623724 (127.13.221.195:36887)
I20260929 11:35:34.271469 14852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11"
I20260929 11:35:34.271492 14999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27557cca002843eeaab4de5b3dc4a72c" candidate_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "772cf848433a42958ebe6446e4623724"
I20260929 11:35:34.272145 14852 raft_consensus.cc:3032] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:35:34.272189 14999 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:34.272496 14852 raft_consensus.cc:729] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fd4c0563b37a4f63a19afe4dd1d7bd11, State: Running, Role: LEADER
I20260929 11:35:34.273231 14852 consensus_queue.cc:260] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.274159 14852 raft_consensus.cc:3037] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:35:34.277529 14999 raft_consensus.cc:2454] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 4.
I20260929 11:35:34.278546 14892 leader_election.cc:302] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772cf848433a42958ebe6446e4623724, 84e586c04f3849e89bfbb1ff24fd3dd3; no voters:
I20260929 11:35:34.278764 14852 raft_consensus.cc:2454] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84e586c04f3849e89bfbb1ff24fd3dd3 in term 4.
I20260929 11:35:34.279222 15176 raft_consensus.cc:2781] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:35:34.279599 15176 raft_consensus.cc:686] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 LEADER]: Becoming Leader. State: Replica: 84e586c04f3849e89bfbb1ff24fd3dd3, State: Running, Role: LEADER
I20260929 11:35:34.280494 15176 consensus_queue.cc:237] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } }
I20260929 11:35:34.287070 14749 catalog_manager.cc:5495] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 reported cstate change: term changed from 3 to 4, leader changed from fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193) to 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194). New cstate: current_term: 4 leader_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:34.422663 14999 raft_consensus.cc:1261] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:34.423794 15176 consensus_queue.cc:1035] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:35:34.433171 14852 raft_consensus.cc:1261] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:35:34.434739 15203 consensus_queue.cc:1035] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:35:34.564841 14852 raft_consensus.cc:1261] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Refusing update from remote peer 772cf848433a42958ebe6446e4623724: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:35:34.566053 15166 consensus_queue.cc:1035] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:35:34.575280 14926 raft_consensus.cc:1261] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Refusing update from remote peer 772cf848433a42958ebe6446e4623724: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:35:34.577642 15166 consensus_queue.cc:1035] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:35:34.586444 14926 raft_consensus.cc:1261] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Refusing update from remote peer 772cf848433a42958ebe6446e4623724: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:34.587764 15166 consensus_queue.cc:1035] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e586c04f3849e89bfbb1ff24fd3dd3" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:34.596884 14852 raft_consensus.cc:1261] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Refusing update from remote peer 772cf848433a42958ebe6446e4623724: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:34.598575 15220 consensus_queue.cc:1035] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:35:34.702862 14999 raft_consensus.cc:1261] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:35:34.704105 15203 consensus_queue.cc:1035] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "772cf848433a42958ebe6446e4623724" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 36887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:35:34.712895 14852 raft_consensus.cc:1261] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Refusing update from remote peer 84e586c04f3849e89bfbb1ff24fd3dd3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:35:34.714097 15176 consensus_queue.cc:1035] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd4c0563b37a4f63a19afe4dd1d7bd11" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 42605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:35:35.007566 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:35.012523 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:35.012948 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:36.013799 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:36.018841 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:36.019339 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:37.020236 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:37.025789 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:37.026226 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:38.026980 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:38.033234 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:38.033793 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:39.034597 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:39.040009 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:39.040436 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:40.041142 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:40.046059 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:40.046452 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:41.047236 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:41.052696 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:41.053076 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:42.053830 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:42.059710 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:42.060163 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:43.061044 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:35:43.067380 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:35:43.067749 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:35:44.099994 14199 auto_leader_rebalancer-test.cc:384] The leader distribution is
I20260929 11:35:44.100746 14199 tablet_server.cc:178] TabletServer@127.13.221.193:0 shutting down...
W20260929 11:35:44.121454 14965 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260929 11:35:44.126019 14965 consensus_peers.cc:487] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 -> Peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Couldn't send request to peer fd4c0563b37a4f63a19afe4dd1d7bd11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:35:44.130203 14891 consensus_peers.cc:487] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 -> Peer fd4c0563b37a4f63a19afe4dd1d7bd11 (127.13.221.193:42605): Couldn't send request to peer fd4c0563b37a4f63a19afe4dd1d7bd11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:44.135103 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:35:44.135839 14199 tablet_replica.cc:330] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.136564 14199 raft_consensus.cc:2229] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.137784 14199 raft_consensus.cc:2258] T 8f4a732e806e42b6a50a50e5cff2f84c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.140590 14199 tablet_replica.cc:330] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.141304 14199 raft_consensus.cc:2229] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.142201 14199 raft_consensus.cc:2258] T 2e3dc7ce7d894cb2ac31f3501adef337 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.143944 14199 tablet_replica.cc:330] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.144534 14199 raft_consensus.cc:2229] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.144932 14199 raft_consensus.cc:2258] T 03fc552d01a54c5587e1b1bf2f12a9b2 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.146744 14199 tablet_replica.cc:330] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.147282 14199 raft_consensus.cc:2229] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.147720 14199 raft_consensus.cc:2258] T cab678679af24b559ffde00ab2cddc81 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.149608 14199 tablet_replica.cc:330] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.150091 14199 raft_consensus.cc:2229] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.150573 14199 raft_consensus.cc:2258] T 27557cca002843eeaab4de5b3dc4a72c P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.152458 14199 tablet_replica.cc:330] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.152958 14199 raft_consensus.cc:2229] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.154135 14199 raft_consensus.cc:2258] T 8f8bafaf01974fa2819e59aa962defa9 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.156505 14199 tablet_replica.cc:330] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.156917 14199 raft_consensus.cc:2229] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.157272 14199 raft_consensus.cc:2258] T 863f8641fd5e43f59b2a37b31989144a P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.159075 14199 tablet_replica.cc:330] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.159512 14199 raft_consensus.cc:2229] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.160022 14199 raft_consensus.cc:2258] T cc7b64fd5dc148b78df202c4b688927f P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.161648 14199 tablet_replica.cc:330] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.162087 14199 raft_consensus.cc:2229] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.162887 14199 raft_consensus.cc:2258] T c44d0aeb5caf415c92faf30e5b5eaffa P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.164860 14199 tablet_replica.cc:330] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11: stopping tablet replica
I20260929 11:35:44.165367 14199 raft_consensus.cc:2229] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.165980 14199 raft_consensus.cc:2258] T 49235c43d61f495297d42cfcbb5d7630 P fd4c0563b37a4f63a19afe4dd1d7bd11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.199342 14199 tablet_server.cc:194] TabletServer@127.13.221.193:0 shutdown complete.
I20260929 11:35:44.219211 14199 tablet_server.cc:178] TabletServer@127.13.221.194:0 shutting down...
I20260929 11:35:44.245966 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:35:44.246708 14199 tablet_replica.cc:330] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.247404 14199 raft_consensus.cc:2229] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.248520 14199 raft_consensus.cc:2258] T 49235c43d61f495297d42cfcbb5d7630 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.250435 14199 tablet_replica.cc:330] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.251013 14199 raft_consensus.cc:2229] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.251447 14199 raft_consensus.cc:2258] T c44d0aeb5caf415c92faf30e5b5eaffa P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.253309 14199 tablet_replica.cc:330] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.253791 14199 raft_consensus.cc:2229] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.254215 14199 raft_consensus.cc:2258] T cab678679af24b559ffde00ab2cddc81 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.255776 14199 tablet_replica.cc:330] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.256484 14199 raft_consensus.cc:2229] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.257299 14199 raft_consensus.cc:2258] T 27557cca002843eeaab4de5b3dc4a72c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.258889 14199 tablet_replica.cc:330] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.259364 14199 raft_consensus.cc:2229] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.259850 14199 raft_consensus.cc:2258] T 8f8bafaf01974fa2819e59aa962defa9 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.261535 14199 tablet_replica.cc:330] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.262013 14199 raft_consensus.cc:2229] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.262399 14199 raft_consensus.cc:2258] T 863f8641fd5e43f59b2a37b31989144a P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.263999 14199 tablet_replica.cc:330] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.264616 14199 raft_consensus.cc:2229] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.265141 14199 raft_consensus.cc:2258] T cc7b64fd5dc148b78df202c4b688927f P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.266781 14199 tablet_replica.cc:330] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.267246 14199 raft_consensus.cc:2229] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.267683 14199 raft_consensus.cc:2258] T 8f4a732e806e42b6a50a50e5cff2f84c P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.269304 14199 tablet_replica.cc:330] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.269764 14199 raft_consensus.cc:2229] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.270526 14199 raft_consensus.cc:2258] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.272096 14199 tablet_replica.cc:330] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3: stopping tablet replica
I20260929 11:35:44.272563 14199 raft_consensus.cc:2229] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.273054 14199 raft_consensus.cc:2258] T 2e3dc7ce7d894cb2ac31f3501adef337 P 84e586c04f3849e89bfbb1ff24fd3dd3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.302340 14199 tablet_server.cc:194] TabletServer@127.13.221.194:0 shutdown complete.
W20260929 11:35:44.303709 14966 consensus_peers.cc:487] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 -> Peer 84e586c04f3849e89bfbb1ff24fd3dd3 (127.13.221.194:33057): Couldn't send request to peer 84e586c04f3849e89bfbb1ff24fd3dd3. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.194:33057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:44.321972 14199 tablet_server.cc:178] TabletServer@127.13.221.195:0 shutting down...
I20260929 11:35:44.346638 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:35:44.347289 14199 tablet_replica.cc:330] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.347997 14199 raft_consensus.cc:2229] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.348664 14199 raft_consensus.cc:2258] T c44d0aeb5caf415c92faf30e5b5eaffa P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.350484 14199 tablet_replica.cc:330] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.351013 14199 raft_consensus.cc:2229] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.351524 14199 raft_consensus.cc:2258] T 49235c43d61f495297d42cfcbb5d7630 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.353232 14199 tablet_replica.cc:330] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.353806 14199 raft_consensus.cc:2229] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.354200 14199 raft_consensus.cc:2258] T 03fc552d01a54c5587e1b1bf2f12a9b2 P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.355993 14199 tablet_replica.cc:330] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.356668 14199 raft_consensus.cc:2229] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.357096 14199 raft_consensus.cc:2258] T 2e3dc7ce7d894cb2ac31f3501adef337 P 772cf848433a42958ebe6446e4623724 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.358747 14199 tablet_replica.cc:330] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.359167 14199 raft_consensus.cc:2229] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.359977 14199 raft_consensus.cc:2258] T 863f8641fd5e43f59b2a37b31989144a P 772cf848433a42958ebe6446e4623724 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.361631 14199 tablet_replica.cc:330] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.362052 14199 raft_consensus.cc:2229] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 4 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.362746 14199 raft_consensus.cc:2258] T cc7b64fd5dc148b78df202c4b688927f P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.364207 14199 tablet_replica.cc:330] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.364698 14199 raft_consensus.cc:2229] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.365196 14199 raft_consensus.cc:2258] T 27557cca002843eeaab4de5b3dc4a72c P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.366672 14199 tablet_replica.cc:330] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.367064 14199 raft_consensus.cc:2229] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.367431 14199 raft_consensus.cc:2258] T 8f8bafaf01974fa2819e59aa962defa9 P 772cf848433a42958ebe6446e4623724 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.369007 14199 tablet_replica.cc:330] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.369390 14199 raft_consensus.cc:2229] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.370060 14199 raft_consensus.cc:2258] T cab678679af24b559ffde00ab2cddc81 P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.372116 14199 tablet_replica.cc:330] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724: stopping tablet replica
I20260929 11:35:44.372592 14199 raft_consensus.cc:2229] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:35:44.372947 14199 raft_consensus.cc:2258] T 8f4a732e806e42b6a50a50e5cff2f84c P 772cf848433a42958ebe6446e4623724 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.417847 14199 tablet_server.cc:194] TabletServer@127.13.221.195:0 shutdown complete.
I20260929 11:35:44.440092 14199 master.cc:537] Master@127.13.221.254:34045 shutting down...
I20260929 11:35:44.465564 14199 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:35:44.466125 14199 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:35:44.466410 14199 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3ddef32929264bf2ae4afac74480a88a: stopping tablet replica
I20260929 11:35:44.484867 14199 master.cc:552] Master@127.13.221.254:34045 shutdown complete.
772cf848433a42958ebe6446e4623724 1
84e586c04f3849e89bfbb1ff24fd3dd3 4
fd4c0563b37a4f63a19afe4dd1d7bd11 5
772cf848433a42958ebe6446e4623724 3
84e586c04f3849e89bfbb1ff24fd3dd3 4
fd4c0563b37a4f63a19afe4dd1d7bd11 3
772cf848433a42958ebe6446e4623724 1
84e586c04f3849e89bfbb1ff24fd3dd3 1
fd4c0563b37a4f63a19afe4dd1d7bd11 8
772cf848433a42958ebe6446e4623724 3
84e586c04f3849e89bfbb1ff24fd3dd3 3
fd4c0563b37a4f63a19afe4dd1d7bd11 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29506 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260929 11:35:44.525094 14199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.221.254:38577
I20260929 11:35:44.526109 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:44.531921 15237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:44.532018 15238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:44.532764 15240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:44.534193 14199 server_base.cc:1034] running on GCE node
I20260929 11:35:44.535096 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:44.535284 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:44.535391 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681744535383 us; error 0 us; skew 500 ppm
I20260929 11:35:44.535835 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:44.538605 14199 webserver.cc:460] Webserver started at http://127.13.221.254:41767/ using document root <none> and password file <none>
I20260929 11:35:44.539031 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:44.539182 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:44.539409 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:44.540690 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/master-0-root/instance:
uuid: "233261f838454e45a0a998f55dba0c89"
format_stamp: "Formatted at 2026-09-29 11:35:44 on dist-test-slave-szp1"
I20260929 11:35:44.545116 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260929 11:35:44.548316 15245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.549136 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260929 11:35:44.549450 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/master-0-root
uuid: "233261f838454e45a0a998f55dba0c89"
format_stamp: "Formatted at 2026-09-29 11:35:44 on dist-test-slave-szp1"
I20260929 11:35:44.549755 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:44.562933 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:44.564127 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:44.601030 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.254:38577
I20260929 11:35:44.601125 15296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.254:38577 every 8 connection(s)
I20260929 11:35:44.605141 15297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:44.615010 15297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89: Bootstrap starting.
I20260929 11:35:44.619422 15297 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:44.623739 15297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89: No bootstrap required, opened a new log
I20260929 11:35:44.625880 15297 raft_consensus.cc:348] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233261f838454e45a0a998f55dba0c89" member_type: VOTER }
I20260929 11:35:44.626374 15297 raft_consensus.cc:374] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:44.626642 15297 raft_consensus.cc:729] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 233261f838454e45a0a998f55dba0c89, State: Initialized, Role: FOLLOWER
I20260929 11:35:44.627290 15297 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233261f838454e45a0a998f55dba0c89" member_type: VOTER }
I20260929 11:35:44.627763 15297 raft_consensus.cc:388] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 11:35:44.627991 15297 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 11:35:44.628286 15297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:44.632356 15297 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233261f838454e45a0a998f55dba0c89" member_type: VOTER }
I20260929 11:35:44.632896 15297 leader_election.cc:302] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 233261f838454e45a0a998f55dba0c89; no voters:
I20260929 11:35:44.633998 15297 leader_election.cc:288] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 11:35:44.634440 15300 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:44.635730 15300 raft_consensus.cc:686] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 1 LEADER]: Becoming Leader. State: Replica: 233261f838454e45a0a998f55dba0c89, State: Running, Role: LEADER
I20260929 11:35:44.636464 15300 consensus_queue.cc:237] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233261f838454e45a0a998f55dba0c89" member_type: VOTER }
I20260929 11:35:44.637061 15297 sys_catalog.cc:564] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [sys.catalog]: configured and running, proceeding with master startup.
I20260929 11:35:44.641077 15301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "233261f838454e45a0a998f55dba0c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233261f838454e45a0a998f55dba0c89" member_type: VOTER } }
I20260929 11:35:44.641870 15301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [sys.catalog]: This master's current role is: LEADER
I20260929 11:35:44.641811 15302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 233261f838454e45a0a998f55dba0c89. Latest consensus state: current_term: 1 leader_uuid: "233261f838454e45a0a998f55dba0c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233261f838454e45a0a998f55dba0c89" member_type: VOTER } }
I20260929 11:35:44.642431 15302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [sys.catalog]: This master's current role is: LEADER
I20260929 11:35:44.644786 15309 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 11:35:44.652606 15309 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 11:35:44.653666 14199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260929 11:35:44.661600 15309 catalog_manager.cc:1347] Generated new cluster ID: eebe987742cf4f6694109cc19e0988c0
I20260929 11:35:44.661890 15309 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 11:35:44.679724 15309 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 11:35:44.681373 15309 catalog_manager.cc:1504] Loading token signing keys...
I20260929 11:35:44.691937 15309 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89: Generated new TSK 0
I20260929 11:35:44.692700 15309 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 11:35:44.720795 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:44.726603 15318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:44.727866 15319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:44.729763 14199 server_base.cc:1034] running on GCE node
W20260929 11:35:44.729867 15321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:44.730811 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:44.730997 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:44.731191 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681744731164 us; error 0 us; skew 500 ppm
I20260929 11:35:44.731734 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:44.734263 14199 webserver.cc:460] Webserver started at http://127.13.221.193:43157/ using document root <none> and password file <none>
I20260929 11:35:44.734738 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:44.734935 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:44.735190 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:44.736445 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/instance:
uuid: "79f6b689389549ce8079ff46fd514467"
format_stamp: "Formatted at 2026-09-29 11:35:44 on dist-test-slave-szp1"
I20260929 11:35:44.741124 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260929 11:35:44.744426 15326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.745275 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260929 11:35:44.745642 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root
uuid: "79f6b689389549ce8079ff46fd514467"
format_stamp: "Formatted at 2026-09-29 11:35:44 on dist-test-slave-szp1"
I20260929 11:35:44.745994 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:44.759346 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:44.760710 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:44.762188 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:35:44.764532 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:35:44.764740 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.765020 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:35:44.765196 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.804131 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.193:36849
I20260929 11:35:44.804237 15388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.193:36849 every 8 connection(s)
I20260929 11:35:44.808658 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:44.816286 15393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:44.818367 15394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:44.819551 15396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:44.820509 14199 server_base.cc:1034] running on GCE node
I20260929 11:35:44.821856 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:44.822124 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:44.822319 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681744822302 us; error 0 us; skew 500 ppm
I20260929 11:35:44.822969 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:44.824167 15389 heartbeater.cc:347] Connected to a master server at 127.13.221.254:38577
I20260929 11:35:44.824592 15389 heartbeater.cc:464] Registering TS with master...
I20260929 11:35:44.825289 15389 heartbeater.cc:511] Master 127.13.221.254:38577 requested a full tablet report, sending...
I20260929 11:35:44.826045 14199 webserver.cc:460] Webserver started at http://127.13.221.194:39881/ using document root <none> and password file <none>
I20260929 11:35:44.826601 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:44.826859 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:44.827162 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:44.827376 15262 ts_manager.cc:194] Registered new tserver with Master: 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:35:44.828867 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/instance:
uuid: "2b2ed85c4da64515a0664b6c0421e078"
format_stamp: "Formatted at 2026-09-29 11:35:44 on dist-test-slave-szp1"
I20260929 11:35:44.830099 15262 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39982
I20260929 11:35:44.833985 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260929 11:35:44.837273 15401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.838094 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260929 11:35:44.838441 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root
uuid: "2b2ed85c4da64515a0664b6c0421e078"
format_stamp: "Formatted at 2026-09-29 11:35:44 on dist-test-slave-szp1"
I20260929 11:35:44.838706 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:44.859644 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:44.860924 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:44.862471 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:35:44.864769 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:35:44.864995 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.865238 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:35:44.865406 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.903208 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.194:33925
I20260929 11:35:44.903309 15463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.194:33925 every 8 connection(s)
I20260929 11:35:44.907847 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:44.914372 15467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:44.916079 15468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:44.920306 15470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:44.920971 14199 server_base.cc:1034] running on GCE node
I20260929 11:35:44.920919 15464 heartbeater.cc:347] Connected to a master server at 127.13.221.254:38577
I20260929 11:35:44.921526 15464 heartbeater.cc:464] Registering TS with master...
I20260929 11:35:44.922118 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:44.922386 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:44.922369 15464 heartbeater.cc:511] Master 127.13.221.254:38577 requested a full tablet report, sending...
I20260929 11:35:44.922765 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681744922745 us; error 0 us; skew 500 ppm
I20260929 11:35:44.923480 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:44.924724 15262 ts_manager.cc:194] Registered new tserver with Master: 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:44.926208 14199 webserver.cc:460] Webserver started at http://127.13.221.195:41025/ using document root <none> and password file <none>
I20260929 11:35:44.926522 15262 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39990
I20260929 11:35:44.926647 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:44.926832 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:44.927026 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:44.928233 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/instance:
uuid: "adf4734bb02e4108b00fabc552483a18"
format_stamp: "Formatted at 2026-09-29 11:35:44 on dist-test-slave-szp1"
I20260929 11:35:44.932636 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260929 11:35:44.935725 15475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.936548 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260929 11:35:44.936844 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root
uuid: "adf4734bb02e4108b00fabc552483a18"
format_stamp: "Formatted at 2026-09-29 11:35:44 on dist-test-slave-szp1"
I20260929 11:35:44.937112 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:44.956807 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:44.957965 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:44.959398 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:35:44.961692 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:35:44.961912 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:44.962138 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:35:44.962307 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:45.001385 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.195:37107
I20260929 11:35:45.001480 15537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.195:37107 every 8 connection(s)
I20260929 11:35:45.016570 15538 heartbeater.cc:347] Connected to a master server at 127.13.221.254:38577
I20260929 11:35:45.016938 15538 heartbeater.cc:464] Registering TS with master...
I20260929 11:35:45.017607 15538 heartbeater.cc:511] Master 127.13.221.254:38577 requested a full tablet report, sending...
I20260929 11:35:45.019379 15262 ts_manager.cc:194] Registered new tserver with Master: adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:45.020470 14199 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015852941s
I20260929 11:35:45.020984 15262 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39992
I20260929 11:35:45.022912 14199 test_util.cc:268] Using random seed: -1789829207
I20260929 11:35:45.048203 15262 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40004:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260929 11:35:45.054517 15262 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260929 11:35:45.251842 15354 tablet_service.cc:1467] Processing CreateTablet for tablet 290cd2101f81472384670fdea31eaaf6 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260929 11:35:45.253392 15354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 290cd2101f81472384670fdea31eaaf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.254860 15353 tablet_service.cc:1467] Processing CreateTablet for tablet 087e3c24b1194324b1cbedc8cbbdf3cd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260929 11:35:45.257540 15352 tablet_service.cc:1467] Processing CreateTablet for tablet 26f6df46badd473ab3b02a550aa18cc2 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260929 11:35:45.259359 15421 tablet_service.cc:1467] Processing CreateTablet for tablet 0c811ec08bf7499f8b0fa3f8b34fb290 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260929 11:35:45.259877 15351 tablet_service.cc:1467] Processing CreateTablet for tablet 133f7cd27af34f7ebc89e90b65170522 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260929 11:35:45.260747 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c811ec08bf7499f8b0fa3f8b34fb290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.263074 15349 tablet_service.cc:1467] Processing CreateTablet for tablet 2f9ef265661b4a1b872b075ece5bb40d (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260929 11:35:45.265271 15348 tablet_service.cc:1467] Processing CreateTablet for tablet 70d952461bcb418b8e68f4389e815978 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260929 11:35:45.265856 15420 tablet_service.cc:1467] Processing CreateTablet for tablet e96d6ce3c2da47089d889e3b488fb3b8 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260929 11:35:45.267138 15420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e96d6ce3c2da47089d889e3b488fb3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.267877 15496 tablet_service.cc:1467] Processing CreateTablet for tablet 40592b40c49441e1a1bb2e582199b023 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260929 11:35:45.268208 15426 tablet_service.cc:1467] Processing CreateTablet for tablet 133f7cd27af34f7ebc89e90b65170522 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260929 11:35:45.269215 15496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40592b40c49441e1a1bb2e582199b023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.269559 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133f7cd27af34f7ebc89e90b65170522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.273479 15425 tablet_service.cc:1467] Processing CreateTablet for tablet 06a45ce12d33457f8e8a937ebe912eff (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260929 11:35:45.274854 15425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06a45ce12d33457f8e8a937ebe912eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.277531 15424 tablet_service.cc:1467] Processing CreateTablet for tablet 2f9ef265661b4a1b872b075ece5bb40d (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260929 11:35:45.278858 15424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f9ef265661b4a1b872b075ece5bb40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.281500 15423 tablet_service.cc:1467] Processing CreateTablet for tablet 70d952461bcb418b8e68f4389e815978 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260929 11:35:45.282804 15423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d952461bcb418b8e68f4389e815978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.285408 15503 tablet_service.cc:1467] Processing CreateTablet for tablet 290cd2101f81472384670fdea31eaaf6 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260929 11:35:45.286669 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 290cd2101f81472384670fdea31eaaf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.289481 15502 tablet_service.cc:1467] Processing CreateTablet for tablet 087e3c24b1194324b1cbedc8cbbdf3cd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260929 11:35:45.290771 15502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087e3c24b1194324b1cbedc8cbbdf3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.293540 15501 tablet_service.cc:1467] Processing CreateTablet for tablet 26f6df46badd473ab3b02a550aa18cc2 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260929 11:35:45.294898 15501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f6df46badd473ab3b02a550aa18cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.297492 15500 tablet_service.cc:1467] Processing CreateTablet for tablet 133f7cd27af34f7ebc89e90b65170522 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260929 11:35:45.298806 15500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133f7cd27af34f7ebc89e90b65170522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.301468 15499 tablet_service.cc:1467] Processing CreateTablet for tablet 06a45ce12d33457f8e8a937ebe912eff (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260929 11:35:45.302807 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06a45ce12d33457f8e8a937ebe912eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.305472 15498 tablet_service.cc:1467] Processing CreateTablet for tablet 2f9ef265661b4a1b872b075ece5bb40d (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260929 11:35:45.306758 15498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f9ef265661b4a1b872b075ece5bb40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.307346 15421 tablet_service.cc:1467] Processing CreateTablet for tablet 85b927b471cd474c88c32acd488f0492 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260929 11:35:45.308552 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b927b471cd474c88c32acd488f0492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.309463 15497 tablet_service.cc:1467] Processing CreateTablet for tablet 70d952461bcb418b8e68f4389e815978 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260929 11:35:45.310725 15497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d952461bcb418b8e68f4389e815978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.257599 15422 tablet_service.cc:1467] Processing CreateTablet for tablet 40592b40c49441e1a1bb2e582199b023 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260929 11:35:45.256201 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087e3c24b1194324b1cbedc8cbbdf3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.313670 15494 tablet_service.cc:1467] Processing CreateTablet for tablet e96d6ce3c2da47089d889e3b488fb3b8 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260929 11:35:45.314037 15495 tablet_service.cc:1467] Processing CreateTablet for tablet 0c811ec08bf7499f8b0fa3f8b34fb290 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260929 11:35:45.315008 15494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e96d6ce3c2da47089d889e3b488fb3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.316138 15427 tablet_service.cc:1467] Processing CreateTablet for tablet 26f6df46badd473ab3b02a550aa18cc2 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260929 11:35:45.319384 15428 tablet_service.cc:1467] Processing CreateTablet for tablet 087e3c24b1194324b1cbedc8cbbdf3cd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260929 11:35:45.319334 15429 tablet_service.cc:1467] Processing CreateTablet for tablet 290cd2101f81472384670fdea31eaaf6 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260929 11:35:45.337931 15347 tablet_service.cc:1467] Processing CreateTablet for tablet 40592b40c49441e1a1bb2e582199b023 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260929 11:35:45.368134 15350 tablet_service.cc:1467] Processing CreateTablet for tablet 06a45ce12d33457f8e8a937ebe912eff (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260929 11:35:45.372794 15427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f6df46badd473ab3b02a550aa18cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.374017 15422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40592b40c49441e1a1bb2e582199b023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.375309 15495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c811ec08bf7499f8b0fa3f8b34fb290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.374058 15351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133f7cd27af34f7ebc89e90b65170522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.380666 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f6df46badd473ab3b02a550aa18cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.384676 15349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f9ef265661b4a1b872b075ece5bb40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.385445 15429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 290cd2101f81472384670fdea31eaaf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.387913 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d952461bcb418b8e68f4389e815978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.389060 15428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 087e3c24b1194324b1cbedc8cbbdf3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.389778 15350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06a45ce12d33457f8e8a937ebe912eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.400835 15347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40592b40c49441e1a1bb2e582199b023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.401922 15346 tablet_service.cc:1467] Processing CreateTablet for tablet 0c811ec08bf7499f8b0fa3f8b34fb290 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260929 11:35:45.403867 15346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c811ec08bf7499f8b0fa3f8b34fb290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.404687 15345 tablet_service.cc:1467] Processing CreateTablet for tablet e96d6ce3c2da47089d889e3b488fb3b8 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260929 11:35:45.406056 15345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e96d6ce3c2da47089d889e3b488fb3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.411959 15553 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:45.417812 15420 tablet_service.cc:1467] Processing CreateTablet for tablet a423a044a6d34d8d86e6a2009617a53c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260929 11:35:45.419198 15420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a423a044a6d34d8d86e6a2009617a53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.438122 15426 tablet_service.cc:1467] Processing CreateTablet for tablet 3076393f65ab418199a711fc32bd3818 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260929 11:35:45.439618 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3076393f65ab418199a711fc32bd3818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.440024 15425 tablet_service.cc:1467] Processing CreateTablet for tablet f969b15260af489b992eeca4080e55ed (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260929 11:35:45.443544 15425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f969b15260af489b992eeca4080e55ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.438709 15421 tablet_service.cc:1467] Processing CreateTablet for tablet 5471502e24764effae2ab947ad5c8cb5 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260929 11:35:45.448853 15424 tablet_service.cc:1467] Processing CreateTablet for tablet 809d1abd25d74defa0a2869d15a553b7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260929 11:35:45.456542 15426 tablet_service.cc:1467] Processing CreateTablet for tablet e9bdacdc58094518aa9198105dee0e0b (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260929 11:35:45.457931 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9bdacdc58094518aa9198105dee0e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.465732 15499 tablet_service.cc:1467] Processing CreateTablet for tablet 5471502e24764effae2ab947ad5c8cb5 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260929 11:35:45.467113 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5471502e24764effae2ab947ad5c8cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.475665 15420 tablet_service.cc:1467] Processing CreateTablet for tablet 20bfb5db2aab4679856838ec11feffc9 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260929 11:35:45.477401 15420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20bfb5db2aab4679856838ec11feffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.482571 15497 tablet_service.cc:1467] Processing CreateTablet for tablet a423a044a6d34d8d86e6a2009617a53c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260929 11:35:45.483986 15497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a423a044a6d34d8d86e6a2009617a53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.485476 15501 tablet_service.cc:1467] Processing CreateTablet for tablet 3076393f65ab418199a711fc32bd3818 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260929 11:35:45.493605 15500 tablet_service.cc:1467] Processing CreateTablet for tablet f969b15260af489b992eeca4080e55ed (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260929 11:35:45.494976 15500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f969b15260af489b992eeca4080e55ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.505327 15422 tablet_service.cc:1467] Processing CreateTablet for tablet ab09a2671e654142a7a9d0078aff91ff (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260929 11:35:45.506191 15425 tablet_service.cc:1467] Processing CreateTablet for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260929 11:35:45.506659 15422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab09a2671e654142a7a9d0078aff91ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.507426 15425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.507750 15499 tablet_service.cc:1467] Processing CreateTablet for tablet 809d1abd25d74defa0a2869d15a553b7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260929 11:35:45.508991 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 809d1abd25d74defa0a2869d15a553b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.508659 15426 tablet_service.cc:1467] Processing CreateTablet for tablet 1839f2d147ac4c7a91bafb727fb103cd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260929 11:35:45.517143 15498 tablet_service.cc:1467] Processing CreateTablet for tablet e9bdacdc58094518aa9198105dee0e0b (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260929 11:35:45.531939 15553 tablet_bootstrap.cc:654] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:45.521278 15420 tablet_service.cc:1467] Processing CreateTablet for tablet 082d372bd5004d6e90543b4fe1ba1b88 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260929 11:35:45.530860 15494 tablet_service.cc:1467] Processing CreateTablet for tablet 85b927b471cd474c88c32acd488f0492 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260929 11:35:45.520919 15500 tablet_service.cc:1467] Processing CreateTablet for tablet 20bfb5db2aab4679856838ec11feffc9 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260929 11:35:45.534303 15494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b927b471cd474c88c32acd488f0492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.534704 15499 tablet_service.cc:1467] Processing CreateTablet for tablet ab09a2671e654142a7a9d0078aff91ff (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260929 11:35:45.535889 15498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9bdacdc58094518aa9198105dee0e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.537410 15353 tablet_service.cc:1467] Processing CreateTablet for tablet 5471502e24764effae2ab947ad5c8cb5 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260929 11:35:45.538699 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5471502e24764effae2ab947ad5c8cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.542008 15497 tablet_service.cc:1467] Processing CreateTablet for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260929 11:35:45.543394 15497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.530853 15352 tablet_service.cc:1467] Processing CreateTablet for tablet 85b927b471cd474c88c32acd488f0492 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260929 11:35:45.550333 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b927b471cd474c88c32acd488f0492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.564788 15497 tablet_service.cc:1467] Processing CreateTablet for tablet 1839f2d147ac4c7a91bafb727fb103cd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260929 11:35:45.566452 15497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1839f2d147ac4c7a91bafb727fb103cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.570648 15425 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4452619bf4405caf985d1675be1408 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260929 11:35:45.587286 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1839f2d147ac4c7a91bafb727fb103cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.588172 15501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3076393f65ab418199a711fc32bd3818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.602008 15350 tablet_service.cc:1467] Processing CreateTablet for tablet a423a044a6d34d8d86e6a2009617a53c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260929 11:35:45.604228 15350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a423a044a6d34d8d86e6a2009617a53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.606344 15423 tablet_service.cc:1467] Processing CreateTablet for tablet b96455e9e76c407ab71b312b680a9c93 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260929 11:35:45.628396 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5471502e24764effae2ab947ad5c8cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.629817 15351 tablet_service.cc:1467] Processing CreateTablet for tablet 3076393f65ab418199a711fc32bd3818 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260929 11:35:45.630497 15494 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4452619bf4405caf985d1675be1408 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260929 11:35:45.631116 15351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3076393f65ab418199a711fc32bd3818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.631805 15424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 809d1abd25d74defa0a2869d15a553b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.632383 15500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20bfb5db2aab4679856838ec11feffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.633476 15496 tablet_service.cc:1467] Processing CreateTablet for tablet 082d372bd5004d6e90543b4fe1ba1b88 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260929 11:35:45.634703 15496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 082d372bd5004d6e90543b4fe1ba1b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.637145 15420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 082d372bd5004d6e90543b4fe1ba1b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.637506 15349 tablet_service.cc:1467] Processing CreateTablet for tablet f969b15260af489b992eeca4080e55ed (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260929 11:35:45.638731 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab09a2671e654142a7a9d0078aff91ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.642185 15555 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:45.642848 15494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4452619bf4405caf985d1675be1408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.643854 15498 tablet_service.cc:1467] Processing CreateTablet for tablet 82d77475379646a99d34b739d3cfde14 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260929 11:35:45.645457 15498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d77475379646a99d34b739d3cfde14. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:35:45.646793 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:45.638756 15349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f969b15260af489b992eeca4080e55ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.642539 15502 tablet_service.cc:1467] Processing CreateTablet for tablet 5af50e35934e4cd3960c886105fb34b7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260929 11:35:45.648999 15502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af50e35934e4cd3960c886105fb34b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.649281 15553 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:45.649763 15553 ts_tablet_manager.cc:1397] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.238s user 0.020s sys 0.025s
I20260929 11:35:45.649775 15554 tablet_bootstrap.cc:492] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:45.651948 15495 tablet_service.cc:1467] Processing CreateTablet for tablet 69f25939e19c461ab830dd08f6e6b790 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260929 11:35:45.653792 15495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f25939e19c461ab830dd08f6e6b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.666070 15497 tablet_service.cc:1467] Processing CreateTablet for tablet 3fd843b2d55b4a9bb4755e0841e3c66e (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260929 11:35:45.667387 15497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fd843b2d55b4a9bb4755e0841e3c66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.667152 15503 tablet_service.cc:1467] Processing CreateTablet for tablet b96455e9e76c407ab71b312b680a9c93 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260929 11:35:45.675796 15553 raft_consensus.cc:348] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:45.676625 15553 raft_consensus.cc:374] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:45.676930 15553 raft_consensus.cc:729] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:45.663540 15354 tablet_service.cc:1467] Processing CreateTablet for tablet 20bfb5db2aab4679856838ec11feffc9 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260929 11:35:45.681131 15354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20bfb5db2aab4679856838ec11feffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.659768 15348 tablet_service.cc:1467] Processing CreateTablet for tablet 809d1abd25d74defa0a2869d15a553b7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260929 11:35:45.684499 15554 tablet_bootstrap.cc:654] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:45.684782 15425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4452619bf4405caf985d1675be1408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.685146 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 809d1abd25d74defa0a2869d15a553b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.688643 15423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b96455e9e76c407ab71b312b680a9c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.693747 15353 tablet_service.cc:1467] Processing CreateTablet for tablet ab09a2671e654142a7a9d0078aff91ff (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260929 11:35:45.694090 15427 tablet_service.cc:1467] Processing CreateTablet for tablet 82d77475379646a99d34b739d3cfde14 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260929 11:35:45.695039 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab09a2671e654142a7a9d0078aff91ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.695338 15427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d77475379646a99d34b739d3cfde14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.693764 15429 tablet_service.cc:1467] Processing CreateTablet for tablet 5af50e35934e4cd3960c886105fb34b7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260929 11:35:45.697811 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b96455e9e76c407ab71b312b680a9c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.698508 15429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af50e35934e4cd3960c886105fb34b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.698146 15553 consensus_queue.cc:260] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:45.660247 15347 tablet_service.cc:1467] Processing CreateTablet for tablet e9bdacdc58094518aa9198105dee0e0b (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260929 11:35:45.708076 15347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9bdacdc58094518aa9198105dee0e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.709429 15464 heartbeater.cc:503] Master 127.13.221.254:38577 was elected leader, sending a full tablet report...
I20260929 11:35:45.711596 15553 ts_tablet_manager.cc:1428] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.039s user 0.007s sys 0.000s
I20260929 11:35:45.730835 15494 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4407712ee0451cb4fb2d8569e604cc (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260929 11:35:45.734165 15554 tablet_bootstrap.cc:492] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:45.767657 15554 ts_tablet_manager.cc:1397] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.118s user 0.007s sys 0.008s
I20260929 11:35:45.767853 15553 tablet_bootstrap.cc:492] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:45.768230 15494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4407712ee0451cb4fb2d8569e604cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.747340 15420 tablet_service.cc:1467] Processing CreateTablet for tablet 3fd843b2d55b4a9bb4755e0841e3c66e (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260929 11:35:45.769145 15420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fd843b2d55b4a9bb4755e0841e3c66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.770393 15554 raft_consensus.cc:348] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:45.771176 15554 raft_consensus.cc:374] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:45.771490 15554 raft_consensus.cc:729] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:45.746997 15422 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4407712ee0451cb4fb2d8569e604cc (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260929 11:35:45.773294 15422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4407712ee0451cb4fb2d8569e604cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.761606 15423 tablet_service.cc:1467] Processing CreateTablet for tablet c7c9ca97877f48c9ba1c6a3503576624 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260929 11:35:45.755167 15496 tablet_service.cc:1467] Processing CreateTablet for tablet 293283a1ffae44dfb01a86f8eaf344f0 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260929 11:35:45.775034 15423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c9ca97877f48c9ba1c6a3503576624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.776094 15496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293283a1ffae44dfb01a86f8eaf344f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.777213 15351 tablet_service.cc:1467] Processing CreateTablet for tablet b96455e9e76c407ab71b312b680a9c93 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260929 11:35:45.778527 15351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b96455e9e76c407ab71b312b680a9c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.738559 15555 tablet_bootstrap.cc:654] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:45.741199 15349 tablet_service.cc:1467] Processing CreateTablet for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260929 11:35:45.741911 15345 tablet_service.cc:1467] Processing CreateTablet for tablet 082d372bd5004d6e90543b4fe1ba1b88 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260929 11:35:45.737164 15428 tablet_service.cc:1467] Processing CreateTablet for tablet 69f25939e19c461ab830dd08f6e6b790 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260929 11:35:45.745357 15499 tablet_service.cc:1467] Processing CreateTablet for tablet e9309f2844e444faaf2fbd9f0b77b132 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260929 11:35:45.744311 15502 tablet_service.cc:1467] Processing CreateTablet for tablet c7c9ca97877f48c9ba1c6a3503576624 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260929 11:35:45.749691 15498 tablet_service.cc:1467] Processing CreateTablet for tablet 18064e092cec4a5fbc144b23fcd5abaf (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260929 11:35:45.791477 15428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f25939e19c461ab830dd08f6e6b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.746744 15350 tablet_service.cc:1467] Processing CreateTablet for tablet 1839f2d147ac4c7a91bafb727fb103cd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260929 11:35:45.793081 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9309f2844e444faaf2fbd9f0b77b132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.797638 15498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18064e092cec4a5fbc144b23fcd5abaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.784646 15554 consensus_queue.cc:260] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:45.793995 15352 tablet_service.cc:1467] Processing CreateTablet for tablet 5af50e35934e4cd3960c886105fb34b7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260929 11:35:45.794657 15349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.799988 15345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 082d372bd5004d6e90543b4fe1ba1b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.800751 15350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1839f2d147ac4c7a91bafb727fb103cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.805884 15553 tablet_bootstrap.cc:654] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:45.819443 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af50e35934e4cd3960c886105fb34b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.800009 15502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c9ca97877f48c9ba1c6a3503576624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.833352 15389 heartbeater.cc:503] Master 127.13.221.254:38577 was elected leader, sending a full tablet report...
I20260929 11:35:45.753340 15346 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4452619bf4405caf985d1675be1408 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260929 11:35:45.850337 15346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4452619bf4405caf985d1675be1408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.854805 15353 tablet_service.cc:1467] Processing CreateTablet for tablet 82d77475379646a99d34b739d3cfde14 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20260929 11:35:45.849462 15246 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 44701.2us
I20260929 11:35:45.859772 15424 tablet_service.cc:1467] Processing CreateTablet for tablet 7eb6a5845e93469fb6516bd75d62c983 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260929 11:35:45.870013 15424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eb6a5845e93469fb6516bd75d62c983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.875420 15501 tablet_service.cc:1467] Processing CreateTablet for tablet 7721312177b84c71ae4f6bea151091a8 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260929 11:35:45.868105 15426 tablet_service.cc:1467] Processing CreateTablet for tablet 293283a1ffae44dfb01a86f8eaf344f0 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260929 11:35:45.876802 15501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7721312177b84c71ae4f6bea151091a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.877353 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293283a1ffae44dfb01a86f8eaf344f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.882071 15421 tablet_service.cc:1467] Processing CreateTablet for tablet 7721312177b84c71ae4f6bea151091a8 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260929 11:35:45.883383 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7721312177b84c71ae4f6bea151091a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.891134 15352 tablet_service.cc:1467] Processing CreateTablet for tablet 69f25939e19c461ab830dd08f6e6b790 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260929 11:35:45.892611 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f25939e19c461ab830dd08f6e6b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.899370 15495 tablet_service.cc:1467] Processing CreateTablet for tablet e4f3d509852942e2b45c13e1f5c5ea8d (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260929 11:35:45.901561 15426 tablet_service.cc:1467] Processing CreateTablet for tablet e4f3d509852942e2b45c13e1f5c5ea8d (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260929 11:35:45.765425 15429 tablet_service.cc:1467] Processing CreateTablet for tablet 18064e092cec4a5fbc144b23fcd5abaf (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260929 11:35:45.905148 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d77475379646a99d34b739d3cfde14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.903162 15347 tablet_service.cc:1467] Processing CreateTablet for tablet 3fd843b2d55b4a9bb4755e0841e3c66e (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260929 11:35:45.906847 15347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fd843b2d55b4a9bb4755e0841e3c66e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.906980 15554 ts_tablet_manager.cc:1428] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.139s user 0.002s sys 0.008s
I20260929 11:35:45.909096 15538 heartbeater.cc:503] Master 127.13.221.254:38577 was elected leader, sending a full tablet report...
I20260929 11:35:45.910074 15554 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:45.909866 15346 tablet_service.cc:1467] Processing CreateTablet for tablet 4d4407712ee0451cb4fb2d8569e604cc (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260929 11:35:45.911451 15346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d4407712ee0451cb4fb2d8569e604cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.763592 15427 tablet_service.cc:1467] Processing CreateTablet for tablet e9309f2844e444faaf2fbd9f0b77b132 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260929 11:35:45.917987 15555 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:45.918503 15555 ts_tablet_manager.cc:1397] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.277s user 0.010s sys 0.010s
I20260929 11:35:45.920867 15425 tablet_service.cc:1467] Processing CreateTablet for tablet 2454e1272e994181a08e49e54473af7a (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260929 11:35:45.921301 15555 raft_consensus.cc:348] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:45.922127 15555 raft_consensus.cc:374] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:45.922421 15555 raft_consensus.cc:729] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:45.923233 15555 consensus_queue.cc:260] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:45.935469 15354 tablet_service.cc:1467] Processing CreateTablet for tablet c7c9ca97877f48c9ba1c6a3503576624 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260929 11:35:45.936501 15495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f3d509852942e2b45c13e1f5c5ea8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.937109 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f3d509852942e2b45c13e1f5c5ea8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.939616 15497 tablet_service.cc:1467] Processing CreateTablet for tablet 34b22fc778c04f25b5b0fe1635280e0c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260929 11:35:45.938200 15348 tablet_service.cc:1467] Processing CreateTablet for tablet e9309f2844e444faaf2fbd9f0b77b132 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260929 11:35:45.940342 15500 tablet_service.cc:1467] Processing CreateTablet for tablet 7eb6a5845e93469fb6516bd75d62c983 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260929 11:35:45.952167 15420 tablet_service.cc:1467] Processing CreateTablet for tablet 34b22fc778c04f25b5b0fe1635280e0c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260929 11:35:45.957554 15497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34b22fc778c04f25b5b0fe1635280e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.957820 15427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9309f2844e444faaf2fbd9f0b77b132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.958998 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9309f2844e444faaf2fbd9f0b77b132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.960600 15558 raft_consensus.cc:482] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:45.994225 15558 raft_consensus.cc:504] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:45.996802 15558 leader_election.cc:288] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:45.967173 15554 tablet_bootstrap.cc:654] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:45.997797 15351 tablet_service.cc:1467] Processing CreateTablet for tablet 7eb6a5845e93469fb6516bd75d62c983 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260929 11:35:45.979382 15561 raft_consensus.cc:482] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:45.984912 15420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34b22fc778c04f25b5b0fe1635280e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.985561 15424 tablet_service.cc:1467] Processing CreateTablet for tablet 7272ea4499be458a8d957a25b7d508bb (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260929 11:35:45.985778 15503 tablet_service.cc:1467] Processing CreateTablet for tablet 7272ea4499be458a8d957a25b7d508bb (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260929 11:35:45.986624 15500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eb6a5845e93469fb6516bd75d62c983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.987308 15354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c9ca97877f48c9ba1c6a3503576624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:45.988787 15428 tablet_service.cc:1467] Processing CreateTablet for tablet 85688ae966734650b9fca8130f2feb8c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260929 11:35:45.989300 15352 tablet_service.cc:1467] Processing CreateTablet for tablet 18064e092cec4a5fbc144b23fcd5abaf (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260929 11:35:45.990803 15499 tablet_service.cc:1467] Processing CreateTablet for tablet 85688ae966734650b9fca8130f2feb8c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260929 11:35:46.023629 15425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2454e1272e994181a08e49e54473af7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.030840 15350 tablet_service.cc:1467] Processing CreateTablet for tablet 293283a1ffae44dfb01a86f8eaf344f0 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260929 11:35:46.039094 15345 tablet_service.cc:1467] Processing CreateTablet for tablet e4f3d509852942e2b45c13e1f5c5ea8d (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260929 11:35:46.040925 15553 tablet_bootstrap.cc:492] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:46.041426 15553 ts_tablet_manager.cc:1397] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.274s user 0.021s sys 0.011s
I20260929 11:35:46.041338 15496 tablet_service.cc:1467] Processing CreateTablet for tablet 9ab10cacb2684573bce3212170485cda (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260929 11:35:46.001245 15561 raft_consensus.cc:504] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.031620 15351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eb6a5845e93469fb6516bd75d62c983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.051748 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7272ea4499be458a8d957a25b7d508bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.030141 15349 tablet_service.cc:1467] Processing CreateTablet for tablet 7721312177b84c71ae4f6bea151091a8 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260929 11:35:46.064465 15424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7272ea4499be458a8d957a25b7d508bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.044214 15553 raft_consensus.cc:348] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.044615 15561 leader_election.cc:288] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:46.086198 15496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ab10cacb2684573bce3212170485cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.086556 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18064e092cec4a5fbc144b23fcd5abaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.092675 15345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f3d509852942e2b45c13e1f5c5ea8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.078151 15553 raft_consensus.cc:374] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.097792 15553 raft_consensus.cc:729] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.098519 15553 consensus_queue.cc:260] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.100764 15498 tablet_service.cc:1467] Processing CreateTablet for tablet 9bdd351cd28a49e5b8a1ed5513b22cf7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260929 11:35:46.102358 15494 tablet_service.cc:1467] Processing CreateTablet for tablet 2454e1272e994181a08e49e54473af7a (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260929 11:35:46.104563 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85688ae966734650b9fca8130f2feb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.109493 15423 tablet_service.cc:1467] Processing CreateTablet for tablet f281c33521294dbdac740fec2f2b0b51 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260929 11:35:46.110050 15554 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:46.109721 15421 tablet_service.cc:1467] Processing CreateTablet for tablet 9bdd351cd28a49e5b8a1ed5513b22cf7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260929 11:35:46.110541 15554 ts_tablet_manager.cc:1397] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.201s user 0.003s sys 0.017s
I20260929 11:35:46.112401 15426 tablet_service.cc:1467] Processing CreateTablet for tablet 9ab10cacb2684573bce3212170485cda (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260929 11:35:46.114650 15422 tablet_service.cc:1467] Processing CreateTablet for tablet d5a187e4fe114b97b83228cf0177ca13 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260929 11:35:46.116655 15555 ts_tablet_manager.cc:1428] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.198s user 0.013s sys 0.002s
I20260929 11:35:46.126736 15553 ts_tablet_manager.cc:1428] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.085s user 0.007s sys 0.002s
I20260929 11:35:46.126907 15555 tablet_bootstrap.cc:492] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:46.131742 15347 tablet_service.cc:1467] Processing CreateTablet for tablet 34b22fc778c04f25b5b0fe1635280e0c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260929 11:35:46.132362 15429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18064e092cec4a5fbc144b23fcd5abaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.078496 15502 tablet_service.cc:1467] Processing CreateTablet for tablet f281c33521294dbdac740fec2f2b0b51 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260929 11:35:46.132872 15498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bdd351cd28a49e5b8a1ed5513b22cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.135700 15553 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:46.115799 15554 raft_consensus.cc:348] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.150791 15554 raft_consensus.cc:374] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.153481 15554 raft_consensus.cc:729] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.154392 15554 consensus_queue.cc:260] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.156728 15494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2454e1272e994181a08e49e54473af7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.157095 15554 ts_tablet_manager.cc:1428] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.046s user 0.006s sys 0.001s
I20260929 11:35:46.157644 15502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f281c33521294dbdac740fec2f2b0b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.158066 15554 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:46.146713 15350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293283a1ffae44dfb01a86f8eaf344f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.167285 15499 tablet_service.cc:1467] Processing CreateTablet for tablet d5a187e4fe114b97b83228cf0177ca13 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260929 11:35:46.168277 15349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7721312177b84c71ae4f6bea151091a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.180658 15422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a187e4fe114b97b83228cf0177ca13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.183362 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ab10cacb2684573bce3212170485cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.184001 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bdd351cd28a49e5b8a1ed5513b22cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.184055 15347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34b22fc778c04f25b5b0fe1635280e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.216506 15346 tablet_service.cc:1467] Processing CreateTablet for tablet 7272ea4499be458a8d957a25b7d508bb (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260929 11:35:46.218228 15346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7272ea4499be458a8d957a25b7d508bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.246788 15559 raft_consensus.cc:482] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:46.247341 15559 raft_consensus.cc:504] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.267571 15428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85688ae966734650b9fca8130f2feb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.268952 15423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f281c33521294dbdac740fec2f2b0b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.269881 15501 tablet_service.cc:1467] Processing CreateTablet for tablet 282bceebd7ed425db943d6b72f2513a1 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260929 11:35:46.272579 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a187e4fe114b97b83228cf0177ca13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.276867 15501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 282bceebd7ed425db943d6b72f2513a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.284214 15494 tablet_service.cc:1467] Processing CreateTablet for tablet bbd4efefe8d54575b3b5575a504bb0a1 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260929 11:35:46.285585 15494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbd4efefe8d54575b3b5575a504bb0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.288395 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:46.290232 15329 leader_election.cc:341] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.293141 15502 tablet_service.cc:1467] Processing CreateTablet for tablet 8119561598f743b799cb3b1843a3507f (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260929 11:35:46.297317 15427 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf31b2803e34f7a9c2d7bdea21cc0bd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260929 11:35:46.294431 15502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8119561598f743b799cb3b1843a3507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.314077 15553 tablet_bootstrap.cc:654] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.319298 15559 leader_election.cc:288] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:46.323825 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:46.325537 15404 leader_election.cc:341] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.327245 15555 tablet_bootstrap.cc:654] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.332953 15427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf31b2803e34f7a9c2d7bdea21cc0bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.334060 15554 tablet_bootstrap.cc:654] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.295869 15495 tablet_service.cc:1467] Processing CreateTablet for tablet 0f77752fd0284cd5acb4a8de83942962 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260929 11:35:46.338325 15503 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 37) took 1007 ms. Trace:
I20260929 11:35:46.338042 15495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f77752fd0284cd5acb4a8de83942962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.338974 15503 rpcz_store.cc:276] 0929 11:35:45.330863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:45.952184 (+621321us) service_pool.cc:227] Handling call
0929 11:35:46.021656 (+ 69472us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.025494 (+ 3838us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.180500 (+155006us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.337738 (+157238us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.338257 (+ 519us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.287494 15500 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf31b2803e34f7a9c2d7bdea21cc0bd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260929 11:35:46.352710 15558 raft_consensus.cc:482] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:46.353232 15558 raft_consensus.cc:504] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.355168 15558 leader_election.cc:288] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:46.356683 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:46.358004 15404 leader_election.cc:341] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.358384 15497 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 36) took 1027 ms. Trace:
I20260929 11:35:46.358795 15497 rpcz_store.cc:276] 0929 11:35:45.330557 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:45.938679 (+608122us) service_pool.cc:227] Handling call
0929 11:35:45.957074 (+ 18395us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:45.957179 (+ 105us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.080097 (+122918us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.357840 (+277743us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.358257 (+ 417us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.359442 15499 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 43) took 1020 ms. Trace:
I20260929 11:35:46.359829 15499 rpcz_store.cc:276] 0929 11:35:45.339119 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.166376 (+827257us) service_pool.cc:227] Handling call
0929 11:35:46.168141 (+ 1765us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.168231 (+ 90us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.342038 (+173807us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.358986 (+ 16948us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.359382 (+ 396us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.361690 15499 tablet_service.cc:1467] Processing CreateTablet for tablet b45a648c1e0b4665ae1e133d8f6fe219 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260929 11:35:46.369321 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
W20260929 11:35:46.371035 15402 leader_election.cc:341] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.371413 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:46.371488 15402 leader_election.cc:302] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:46.373340 15558 raft_consensus.cc:2726] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:35:46.374558 15402 leader_election.cc:341] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.374831 15501 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 45) took 1035 ms. Trace:
I20260929 11:35:46.375118 15402 leader_election.cc:302] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:46.376302 15558 raft_consensus.cc:2726] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:46.381278 15421 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 40) took 1047 ms. Trace:
I20260929 11:35:46.381757 15421 rpcz_store.cc:276] 0929 11:35:45.334121 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.108830 (+774709us) service_pool.cc:227] Handling call
0929 11:35:46.110671 (+ 1841us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.110773 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.290004 (+179231us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.380692 (+ 90688us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.381210 (+ 518us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.385648 15348 tablet_service.cc:1467] Processing CreateTablet for tablet 85688ae966734650b9fca8130f2feb8c (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260929 11:35:46.386965 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85688ae966734650b9fca8130f2feb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.386886 15345 tablet_service.cc:1467] Processing CreateTablet for tablet f281c33521294dbdac740fec2f2b0b51 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260929 11:35:46.388690 15345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f281c33521294dbdac740fec2f2b0b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.390444 15352 tablet_service.cc:1467] Processing CreateTablet for tablet 9bdd351cd28a49e5b8a1ed5513b22cf7 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260929 11:35:46.391656 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bdd351cd28a49e5b8a1ed5513b22cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.375461 15501 rpcz_store.cc:276] 0929 11:35:45.339795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.268945 (+929150us) service_pool.cc:227] Handling call
0929 11:35:46.270678 (+ 1733us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.270780 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.298662 (+ 27882us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.374107 (+ 75445us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.374734 (+ 627us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.395458 15428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 38) took 1061 ms. Trace:
I20260929 11:35:46.395682 15503 tablet_service.cc:1467] Processing CreateTablet for tablet 6926107852c74f4aaf37989b571c292a (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260929 11:35:46.402776 15554 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:46.403306 15554 ts_tablet_manager.cc:1397] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.245s user 0.006s sys 0.006s
I20260929 11:35:46.406095 15554 raft_consensus.cc:348] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.406867 15554 raft_consensus.cc:374] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.407164 15554 raft_consensus.cc:729] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.409333 15496 tablet_service.cc:1467] Processing CreateTablet for tablet bb49a87a20fe49448ce6bec0ace3573f (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260929 11:35:46.409515 15502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 46) took 1066 ms. Trace:
I20260929 11:35:46.409687 15346 tablet_service.cc:1467] Processing CreateTablet for tablet 9ab10cacb2684573bce3212170485cda (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260929 11:35:46.412984 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45a648c1e0b4665ae1e133d8f6fe219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.413681 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6926107852c74f4aaf37989b571c292a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.414884 15422 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 43) took 1078 ms. Trace:
I20260929 11:35:46.415400 15422 rpcz_store.cc:276] 0929 11:35:45.336695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.113826 (+777131us) service_pool.cc:227] Handling call
0929 11:35:46.115421 (+ 1595us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.115509 (+ 88us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.336843 (+221334us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.414220 (+ 77377us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.414809 (+ 589us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.384018 15421 tablet_service.cc:1467] Processing CreateTablet for tablet 282bceebd7ed425db943d6b72f2513a1 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260929 11:35:46.418010 15497 tablet_service.cc:1467] Processing CreateTablet for tablet 29ac378824b145ee99c987e4c3413ee9 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260929 11:35:46.418859 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 282bceebd7ed425db943d6b72f2513a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.419389 15354 tablet_service.cc:1467] Processing CreateTablet for tablet 2454e1272e994181a08e49e54473af7a (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260929 11:35:46.399040 15427 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 44) took 1058 ms. Trace:
I20260929 11:35:46.420619 15346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ab10cacb2684573bce3212170485cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.420857 15427 rpcz_store.cc:276] 0929 11:35:45.340364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.296438 (+956074us) service_pool.cc:227] Handling call
0929 11:35:46.298145 (+ 1707us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.298246 (+ 101us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.385000 (+ 86754us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.391858 (+ 6858us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.392308 (+ 450us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.422698 15427 tablet_service.cc:1467] Processing CreateTablet for tablet 8119561598f743b799cb3b1843a3507f (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260929 11:35:46.410463 15428 rpcz_store.cc:276] 0929 11:35:45.333505 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:45.987877 (+654372us) service_pool.cc:227] Handling call
0929 11:35:46.108162 (+120285us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.108297 (+ 135us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.310555 (+202258us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.394798 (+ 84243us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.395348 (+ 550us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.423913 15427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8119561598f743b799cb3b1843a3507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.424886 15354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2454e1272e994181a08e49e54473af7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.425792 15428 tablet_service.cc:1467] Processing CreateTablet for tablet bbd4efefe8d54575b3b5575a504bb0a1 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260929 11:35:46.426978 15428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbd4efefe8d54575b3b5575a504bb0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.429382 15351 tablet_service.cc:1467] Processing CreateTablet for tablet 0cf31b2803e34f7a9c2d7bdea21cc0bd (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260929 11:35:46.430631 15351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf31b2803e34f7a9c2d7bdea21cc0bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.430300 15422 tablet_service.cc:1467] Processing CreateTablet for tablet 0f77752fd0284cd5acb4a8de83942962 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260929 11:35:46.431579 15422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f77752fd0284cd5acb4a8de83942962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.433835 15353 tablet_service.cc:1467] Processing CreateTablet for tablet 282bceebd7ed425db943d6b72f2513a1 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260929 11:35:46.435022 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 282bceebd7ed425db943d6b72f2513a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.439571 15350 tablet_service.cc:1467] Processing CreateTablet for tablet 8119561598f743b799cb3b1843a3507f (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260929 11:35:46.440891 15350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8119561598f743b799cb3b1843a3507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.407889 15554 consensus_queue.cc:260] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.446683 15420 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 36) took 1113 ms. Trace:
I20260929 11:35:46.453006 15424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 37) took 1118 ms. Trace:
I20260929 11:35:46.456629 15424 rpcz_store.cc:276] 0929 11:35:45.333194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:45.984649 (+651455us) service_pool.cc:227] Handling call
0929 11:35:46.008935 (+ 24286us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.019022 (+ 10087us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.396513 (+377491us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.431980 (+ 35467us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.451135 (+ 19155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.458487 15424 tablet_service.cc:1467] Processing CreateTablet for tablet 29ac378824b145ee99c987e4c3413ee9 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260929 11:35:46.459815 15424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ac378824b145ee99c987e4c3413ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.465725 15349 tablet_service.cc:1467] Processing CreateTablet for tablet d5a187e4fe114b97b83228cf0177ca13 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260929 11:35:46.410152 15502 rpcz_store.cc:276] 0929 11:35:45.342871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.276465 (+933594us) service_pool.cc:227] Handling call
0929 11:35:46.293978 (+ 17513us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.294070 (+ 92us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.324047 (+ 29977us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.408890 (+ 84843us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.409444 (+ 554us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.474685 15502 tablet_service.cc:1467] Processing CreateTablet for tablet ae0c7572ce72494f9c505c54480619fa (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260929 11:35:46.453624 15420 rpcz_store.cc:276] 0929 11:35:45.332867 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:45.948874 (+616007us) service_pool.cc:227] Handling call
0929 11:35:45.984441 (+ 35567us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:45.984541 (+ 100us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.200216 (+215675us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.443710 (+243494us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.446613 (+ 2903us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4717}
I20260929 11:35:46.477809 15420 tablet_service.cc:1467] Processing CreateTablet for tablet b45a648c1e0b4665ae1e133d8f6fe219 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260929 11:35:46.479043 15420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45a648c1e0b4665ae1e133d8f6fe219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.480858 15498 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 40) took 1149 ms. Trace:
I20260929 11:35:46.481261 15498 rpcz_store.cc:276] 0929 11:35:45.331778 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.023232 (+691454us) service_pool.cc:227] Handling call
0929 11:35:46.101595 (+ 78363us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.101699 (+ 104us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.362481 (+260782us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.432038 (+ 69557us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.452631 (+ 20593us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b58001a2298. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934e82 00007f79bf84d8b9 00007f79be7605d8 00007f79be824063 00007f79be81fe2f 00007f79be8205ed 00007f79be7d1869 00007f79b7dd3c44 00007f79b7dd3bd2
0929 11:35:46.480797 (+ 28166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13039872}
I20260929 11:35:46.483108 15498 tablet_service.cc:1467] Processing CreateTablet for tablet e37a9bc249c74356a37d92fe9124c7cc (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260929 11:35:46.492547 15349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a187e4fe114b97b83228cf0177ca13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.499753 15501 tablet_service.cc:1467] Processing CreateTablet for tablet 8351697a268a4337843da29ee5afac70 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260929 11:35:46.509014 15429 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 31) took 1205 ms. Trace:
I20260929 11:35:46.509435 15429 rpcz_store.cc:276] 0929 11:35:45.303332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:45.764593 (+461261us) service_pool.cc:227] Handling call
0929 11:35:45.941889 (+177296us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:45.944872 (+ 2983us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.418009 (+473137us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.508452 (+ 90443us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.508951 (+ 499us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.511313 15429 tablet_service.cc:1467] Processing CreateTablet for tablet bb49a87a20fe49448ce6bec0ace3573f (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260929 11:35:46.454680 15500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cf31b2803e34f7a9c2d7bdea21cc0bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.516072 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40592b40c49441e1a1bb2e582199b023" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:46.514434 15425 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 42) took 1178 ms. Trace:
I20260929 11:35:46.517566 15425 rpcz_store.cc:276] 0929 11:35:45.334780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:45.908519 (+573739us) service_pool.cc:227] Handling call
0929 11:35:45.947483 (+ 38964us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:45.947573 (+ 90us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.437931 (+490358us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.480052 (+ 42121us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.513367 (+ 33315us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.520282 15425 tablet_service.cc:1467] Processing CreateTablet for tablet 6926107852c74f4aaf37989b571c292a (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260929 11:35:46.526011 15423 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 39) took 1192 ms. Trace:
I20260929 11:35:46.526621 15553 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:46.527084 15502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae0c7572ce72494f9c505c54480619fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.527277 15553 ts_tablet_manager.cc:1397] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.392s user 0.020s sys 0.013s
I20260929 11:35:46.527750 15422 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 48) took 1183 ms. Trace:
I20260929 11:35:46.528120 15422 rpcz_store.cc:276] 0929 11:35:45.344599 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.429393 (+1084794us) service_pool.cc:227] Handling call
0929 11:35:46.431165 (+ 1772us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.431259 (+ 94us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.504744 (+ 73485us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.527248 (+ 22504us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.527693 (+ 445us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.529103 15501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8351697a268a4337843da29ee5afac70. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:35:46.523665 15478 leader_election.cc:341] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.502542 15554 ts_tablet_manager.cc:1428] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.099s user 0.008s sys 0.001s
I20260929 11:35:46.530252 15553 raft_consensus.cc:348] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.534633 15496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb49a87a20fe49448ce6bec0ace3573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.537696 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:46.530701 15422 tablet_service.cc:1467] Processing CreateTablet for tablet 8351697a268a4337843da29ee5afac70 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260929 11:35:46.539116 15329 leader_election.cc:341] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.539626 15329 leader_election.cc:302] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:46.541134 15429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb49a87a20fe49448ce6bec0ace3573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.541469 15561 raft_consensus.cc:2726] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:46.548661 15497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ac378824b145ee99c987e4c3413ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.535777 15553 raft_consensus.cc:374] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.552336 15553 raft_consensus.cc:729] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.553278 15498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37a9bc249c74356a37d92fe9124c7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.553108 15553 consensus_queue.cc:260] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.555375 15553 ts_tablet_manager.cc:1428] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.028s user 0.004s sys 0.000s
I20260929 11:35:46.557016 15554 tablet_bootstrap.cc:492] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:46.557911 15555 tablet_bootstrap.cc:492] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:46.558422 15555 ts_tablet_manager.cc:1397] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.432s user 0.032s sys 0.044s
I20260929 11:35:46.561126 15555 raft_consensus.cc:348] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.563683 15559 raft_consensus.cc:482] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:46.571908 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40592b40c49441e1a1bb2e582199b023" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:46.588356 15559 raft_consensus.cc:504] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:46.589280 15476 leader_election.cc:341] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.589708 15476 leader_election.cc:302] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:46.526410 15423 rpcz_store.cc:276] 0929 11:35:45.333820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.108558 (+774738us) service_pool.cc:227] Handling call
0929 11:35:46.110319 (+ 1761us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.110414 (+ 95us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.393083 (+282669us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.525524 (+132441us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.525955 (+ 431us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.574884 15503 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 52) took 1219 ms. Trace:
I20260929 11:35:46.590524 15503 rpcz_store.cc:276] 0929 11:35:45.355030 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.394809 (+1039779us) service_pool.cc:227] Handling call
0929 11:35:46.413242 (+ 18433us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.413344 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.555763 (+142419us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.574358 (+ 18595us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.574821 (+ 463us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.592409 15503 tablet_service.cc:1467] Processing CreateTablet for tablet ed8e53cca3ac4865ba0e4c18b7c9ad6e (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260929 11:35:46.593660 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed8e53cca3ac4865ba0e4c18b7c9ad6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.593832 15421 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 45) took 1253 ms. Trace:
I20260929 11:35:46.594327 15421 rpcz_store.cc:276] 0929 11:35:45.340703 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.382891 (+1042188us) service_pool.cc:227] Handling call
0929 11:35:46.418422 (+ 35531us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.418520 (+ 98us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.463294 (+ 44774us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.540903 (+ 77609us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.593753 (+ 52850us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.577035 15494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 47) took 1233 ms. Trace:
I20260929 11:35:46.595364 15494 rpcz_store.cc:276] 0929 11:35:45.343267 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.283251 (+939984us) service_pool.cc:227] Handling call
0929 11:35:46.285099 (+ 1848us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.285206 (+ 107us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.458080 (+172874us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.576446 (+118366us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.576976 (+ 530us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.598793 15428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 47) took 1254 ms. Trace:
I20260929 11:35:46.599283 15428 rpcz_store.cc:276] 0929 11:35:45.344152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.424120 (+1079968us) service_pool.cc:227] Handling call
0929 11:35:46.426559 (+ 2439us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.426651 (+ 92us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.503475 (+ 76824us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.562238 (+ 58763us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.598721 (+ 36483us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.601296 15428 tablet_service.cc:1467] Processing CreateTablet for tablet ed8e53cca3ac4865ba0e4c18b7c9ad6e (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260929 11:35:46.602751 15426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 41) took 1268 ms. Trace:
I20260929 11:35:46.603109 15426 rpcz_store.cc:276] 0929 11:35:45.334442 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.111495 (+777053us) service_pool.cc:227] Handling call
0929 11:35:46.113204 (+ 1709us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.113295 (+ 91us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.517584 (+404289us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.564391 (+ 46807us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.602691 (+ 38300us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.604928 15426 tablet_service.cc:1467] Processing CreateTablet for tablet 375c6bdafb5c46df89bbbb95795b6812 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260929 11:35:46.606536 15553 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:46.607864 15423 tablet_service.cc:1467] Processing CreateTablet for tablet e37a9bc249c74356a37d92fe9124c7cc (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260929 11:35:46.609750 15494 tablet_service.cc:1467] Processing CreateTablet for tablet 375c6bdafb5c46df89bbbb95795b6812 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260929 11:35:46.611021 15494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 375c6bdafb5c46df89bbbb95795b6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.617102 15348 tablet_service.cc:1467] Processing CreateTablet for tablet 29ac378824b145ee99c987e4c3413ee9 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260929 11:35:46.619897 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ac378824b145ee99c987e4c3413ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.585901 15422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8351697a268a4337843da29ee5afac70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.636720 15428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed8e53cca3ac4865ba0e4c18b7c9ad6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.639194 15351 tablet_service.cc:1467] Processing CreateTablet for tablet 6926107852c74f4aaf37989b571c292a (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260929 11:35:46.639755 15553 tablet_bootstrap.cc:654] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.641041 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 375c6bdafb5c46df89bbbb95795b6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.641537 15495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 48) took 1298 ms. Trace:
I20260929 11:35:46.641884 15495 rpcz_store.cc:276] 0929 11:35:45.343639 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.294905 (+951266us) service_pool.cc:227] Handling call
0929 11:35:46.336702 (+ 41797us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.336825 (+ 123us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.574340 (+237515us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.641021 (+ 66681us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.641479 (+ 458us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.540001 15349 tablet_service.cc:1467] Processing CreateTablet for tablet bbd4efefe8d54575b3b5575a504bb0a1 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260929 11:35:46.596715 15421 tablet_service.cc:1467] Processing CreateTablet for tablet ae0c7572ce72494f9c505c54480619fa (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260929 11:35:46.645764 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae0c7572ce72494f9c505c54480619fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.597872 15555 raft_consensus.cc:374] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.622110 15559 leader_election.cc:288] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:46.622373 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:46.651168 15478 leader_election.cc:341] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.626739 15345 tablet_service.cc:1467] Processing CreateTablet for tablet b45a648c1e0b4665ae1e133d8f6fe219 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260929 11:35:46.652676 15496 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 51) took 1298 ms. Trace:
I20260929 11:35:46.578068 15347 tablet_service.cc:1467] Processing CreateTablet for tablet 0f77752fd0284cd5acb4a8de83942962 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260929 11:35:46.653070 15496 rpcz_store.cc:276] 0929 11:35:45.354692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.393685 (+1038993us) service_pool.cc:227] Handling call
0929 11:35:46.432416 (+ 38731us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.432504 (+ 88us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.576456 (+143952us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.636247 (+ 59791us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.652620 (+ 16373us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.654371 15425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6926107852c74f4aaf37989b571c292a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.656385 15347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f77752fd0284cd5acb4a8de83942962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.660131 15423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37a9bc249c74356a37d92fe9124c7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.660631 15349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbd4efefe8d54575b3b5575a504bb0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.661302 15499 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 50) took 1314 ms. Trace:
I20260929 11:35:46.661708 15499 rpcz_store.cc:276] 0929 11:35:45.347274 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.360774 (+1013500us) service_pool.cc:227] Handling call
0929 11:35:46.362629 (+ 1855us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.362841 (+ 212us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.531165 (+168324us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.660750 (+129585us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.661244 (+ 494us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.628144 15554 tablet_bootstrap.cc:654] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.631459 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:46.630810 15352 tablet_service.cc:1467] Processing CreateTablet for tablet bb49a87a20fe49448ce6bec0ace3573f (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260929 11:35:46.649425 15559 raft_consensus.cc:2726] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:46.649719 15555 raft_consensus.cc:729] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
W20260929 11:35:46.649886 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260929 11:35:46.666471 15465 tablet.cc:2369] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 11:35:46.666584 15351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6926107852c74f4aaf37989b571c292a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.668268 15555 consensus_queue.cc:260] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.670481 15555 ts_tablet_manager.cc:1428] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.112s user 0.003s sys 0.002s
I20260929 11:35:46.671815 15352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb49a87a20fe49448ce6bec0ace3573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.675895 15501 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 53) took 1320 ms. Trace:
I20260929 11:35:46.688473 15501 rpcz_store.cc:276] 0929 11:35:45.355364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.446823 (+1091459us) service_pool.cc:227] Handling call
0929 11:35:46.512533 (+ 65710us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.512649 (+ 116us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.651965 (+139316us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.675396 (+ 23431us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.675835 (+ 439us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.681952 15497 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 49) took 1335 ms. Trace:
I20260929 11:35:46.689746 15497 rpcz_store.cc:276] 0929 11:35:45.346563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.359819 (+1013256us) service_pool.cc:227] Handling call
0929 11:35:46.445558 (+ 85739us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b58001a2298. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be842d21 00007f79be8201e3 00007f79be7d1869 00007f79b7dd3c44 00007f79b7dd3bd2 00007f79b7dd3b01
0929 11:35:46.445706 (+ 148us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.445803 (+ 97us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.613457 (+167654us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.681438 (+ 67981us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.681892 (+ 454us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":53274368}
W20260929 11:35:46.684007 15476 leader_election.cc:341] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.692580 15476 leader_election.cc:302] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:46.694263 15579 raft_consensus.cc:2726] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:46.684767 15420 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 50) took 1338 ms. Trace:
I20260929 11:35:46.686177 15346 tablet_service.cc:1467] Processing CreateTablet for tablet 8351697a268a4337843da29ee5afac70 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260929 11:35:46.679838 15555 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:46.684092 15500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 44) took 1344 ms. Trace:
I20260929 11:35:46.696381 15345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b45a648c1e0b4665ae1e133d8f6fe219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.698307 15346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8351697a268a4337843da29ee5afac70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.696837 15500 rpcz_store.cc:276] 0929 11:35:45.339434 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.285110 (+945676us) service_pool.cc:227] Handling call
0929 11:35:46.350450 (+ 65340us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.350543 (+ 93us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.606408 (+255865us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.683596 (+ 77188us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.684031 (+ 435us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.698637 15427 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 46) took 1357 ms. Trace:
I20260929 11:35:46.698994 15427 rpcz_store.cc:276] 0929 11:35:45.341029 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.421830 (+1080801us) service_pool.cc:227] Handling call
0929 11:35:46.423462 (+ 1632us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.423573 (+ 111us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.603256 (+179683us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.698139 (+ 94883us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.698575 (+ 436us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.643975 15495 tablet_service.cc:1467] Processing CreateTablet for tablet 86dbbec4ace04094a09c85a3ad15d9fb (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260929 11:35:46.701388 15495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86dbbec4ace04094a09c85a3ad15d9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.663578 15429 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 51) took 1295 ms. Trace:
I20260929 11:35:46.714571 15350 tablet_service.cc:1467] Processing CreateTablet for tablet e37a9bc249c74356a37d92fe9124c7cc (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260929 11:35:46.715888 15350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37a9bc249c74356a37d92fe9124c7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.715794 15421 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 54) took 1359 ms. Trace:
I20260929 11:35:46.716284 15421 rpcz_store.cc:276] 0929 11:35:45.356039 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.595486 (+1239447us) service_pool.cc:227] Handling call
0929 11:35:46.645217 (+ 49731us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.645304 (+ 87us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.705950 (+ 60646us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.715302 (+ 9352us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.715733 (+ 431us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.719550 15424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 49) took 1373 ms. Trace:
I20260929 11:35:46.709159 15429 rpcz_store.cc:276] 0929 11:35:45.353645 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.510370 (+1156725us) service_pool.cc:227] Handling call
0929 11:35:46.512085 (+ 1715us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.512188 (+ 103us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.569458 (+ 57270us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.627926 (+ 58468us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.648490 (+ 20564us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.723192 15555 tablet_bootstrap.cc:654] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.727720 15425 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 52) took 1373 ms. Trace:
I20260929 11:35:46.719971 15424 rpcz_store.cc:276] 0929 11:35:45.345795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.457577 (+1111782us) service_pool.cc:227] Handling call
0929 11:35:46.459265 (+ 1688us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.459459 (+ 194us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.640410 (+180951us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.719013 (+ 78603us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.719485 (+ 472us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.737326 15498 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 55) took 1379 ms. Trace:
I20260929 11:35:46.738078 15498 rpcz_store.cc:276] 0929 11:35:45.358024 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.482256 (+1124232us) service_pool.cc:227] Handling call
0929 11:35:46.501042 (+ 18786us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.512437 (+ 11395us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.616635 (+104198us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.736517 (+119882us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.737248 (+ 731us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.732064 15425 rpcz_store.cc:276] 0929 11:35:45.354008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.519329 (+1165321us) service_pool.cc:227] Handling call
0929 11:35:46.535565 (+ 16236us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.593376 (+ 57811us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.717571 (+124195us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.727202 (+ 9631us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.727659 (+ 457us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.731686 15494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 57) took 1368 ms. Trace:
I20260929 11:35:46.745527 15494 rpcz_store.cc:276] 0929 11:35:45.362847 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.599611 (+1236764us) service_pool.cc:227] Handling call
0929 11:35:46.610568 (+ 10957us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.610664 (+ 96us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.714713 (+104049us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.731168 (+ 16455us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.731622 (+ 454us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.734505 15553 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:46.697072 15420 rpcz_store.cc:276] 0929 11:35:45.346152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.476928 (+1130776us) service_pool.cc:227] Handling call
0929 11:35:46.478573 (+ 1645us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.478675 (+ 102us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.650277 (+171602us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.684259 (+ 33982us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.684703 (+ 444us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.749722 15553 ts_tablet_manager.cc:1397] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.143s user 0.026s sys 0.035s
I20260929 11:35:46.728369 15354 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 42) took 1031 ms. Trace:
I20260929 11:35:46.752584 15354 rpcz_store.cc:276] 0929 11:35:45.696706 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.418403 (+721697us) service_pool.cc:227] Handling call
0929 11:35:46.420201 (+ 1798us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.420288 (+ 87us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.563143 (+142855us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.727803 (+164660us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.728276 (+ 473us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.753808 15353 tablet_service.cc:1467] Processing CreateTablet for tablet ae0c7572ce72494f9c505c54480619fa (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260929 11:35:46.757550 15353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae0c7572ce72494f9c505c54480619fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.760668 15354 tablet_service.cc:1467] Processing CreateTablet for tablet ed8e53cca3ac4865ba0e4c18b7c9ad6e (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260929 11:35:46.764360 15354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed8e53cca3ac4865ba0e4c18b7c9ad6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.760816 15427 tablet_service.cc:1467] Processing CreateTablet for tablet 86dbbec4ace04094a09c85a3ad15d9fb (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260929 11:35:46.778069 15427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86dbbec4ace04094a09c85a3ad15d9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.782375 15428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 56) took 1422 ms. Trace:
I20260929 11:35:46.782815 15428 rpcz_store.cc:276] 0929 11:35:45.359724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.600422 (+1240698us) service_pool.cc:227] Handling call
0929 11:35:46.602078 (+ 1656us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.602173 (+ 95us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.663499 (+ 61326us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.781807 (+118308us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.782309 (+ 502us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.784567 15422 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 53) took 1430 ms. Trace:
I20260929 11:35:46.784977 15422 rpcz_store.cc:276] 0929 11:35:45.354314 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.529842 (+1175528us) service_pool.cc:227] Handling call
0929 11:35:46.585267 (+ 55425us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.585397 (+ 130us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.684959 (+ 99562us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.784000 (+ 99041us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.784506 (+ 506us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2197}
I20260929 11:35:46.785761 15553 raft_consensus.cc:348] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.786530 15553 raft_consensus.cc:374] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.786828 15553 raft_consensus.cc:729] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.789974 15347 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 48) took 1044 ms. Trace:
I20260929 11:35:46.790441 15347 rpcz_store.cc:276] 0929 11:35:45.745928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.576809 (+830881us) service_pool.cc:227] Handling call
0929 11:35:46.653328 (+ 76519us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.653420 (+ 92us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.687458 (+ 34038us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.789354 (+101896us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.789912 (+ 558us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.792513 15347 tablet_service.cc:1467] Processing CreateTablet for tablet 375c6bdafb5c46df89bbbb95795b6812 (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260929 11:35:46.793601 15579 raft_consensus.cc:482] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:46.798480 15502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 54) took 1441 ms. Trace:
I20260929 11:35:46.798898 15579 raft_consensus.cc:504] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:46.799382 15246 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 45311.9us
I20260929 11:35:46.801088 15579 leader_election.cc:288] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:46.801625 15426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 57) took 1439 ms. Trace:
I20260929 11:35:46.802050 15426 rpcz_store.cc:276] 0929 11:35:45.362042 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.604025 (+1241983us) service_pool.cc:227] Handling call
0929 11:35:46.605686 (+ 1661us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.605777 (+ 91us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.728607 (+122830us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.801139 (+ 72532us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.801563 (+ 424us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.802896 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:46.803889 15555 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:46.804411 15555 ts_tablet_manager.cc:1397] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.125s user 0.009s sys 0.007s
W20260929 11:35:46.804457 15476 leader_election.cc:341] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.807600 15354 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 56) took 1059 ms. Trace:
I20260929 11:35:46.808266 15561 raft_consensus.cc:482] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:46.797315 15423 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 55) took 1440 ms. Trace:
I20260929 11:35:46.808069 15354 rpcz_store.cc:276] 0929 11:35:45.748574 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.759679 (+1011105us) service_pool.cc:227] Handling call
0929 11:35:46.763662 (+ 3983us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.763801 (+ 139us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.800086 (+ 36285us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.807096 (+ 7010us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.807527 (+ 431us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.808893 15561 raft_consensus.cc:504] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.808939 15423 rpcz_store.cc:276] 0929 11:35:45.357358 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.599076 (+1241718us) service_pool.cc:227] Handling call
0929 11:35:46.608701 (+ 9625us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.608793 (+ 92us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.789685 (+180892us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.796771 (+ 7086us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.797256 (+ 485us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.810954 15561 leader_election.cc:288] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:46.811218 15354 tablet_service.cc:1467] Processing CreateTablet for tablet 86dbbec4ace04094a09c85a3ad15d9fb (DEFAULT_TABLE table=test-workload [id=1cc23d5454934479b89978cacbfee484]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260929 11:35:46.811830 15347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 375c6bdafb5c46df89bbbb95795b6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.812904 15354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86dbbec4ace04094a09c85a3ad15d9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:46.812619 15553 consensus_queue.cc:260] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.813057 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:46.815110 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:46.816283 15329 leader_election.cc:341] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.797899 15503 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 56) took 1437 ms. Trace:
I20260929 11:35:46.817669 15503 rpcz_store.cc:276] 0929 11:35:45.360452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.591476 (+1231024us) service_pool.cc:227] Handling call
0929 11:35:46.593128 (+ 1652us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.593220 (+ 92us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.630986 (+ 37766us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.797409 (+166423us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.797841 (+ 432us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.816697 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:46.823917 15439 raft_consensus.cc:2454] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
W20260929 11:35:46.821082 15329 leader_election.cc:341] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.824960 15329 leader_election.cc:302] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:46.825137 15478 leader_election.cc:302] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters: 79f6b689389549ce8079ff46fd514467
I20260929 11:35:46.825455 15554 tablet_bootstrap.cc:492] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:46.825946 15554 ts_tablet_manager.cc:1397] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.269s user 0.018s sys 0.003s
I20260929 11:35:46.826272 15561 raft_consensus.cc:2726] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:46.827191 15346 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 53) took 1079 ms. Trace:
I20260929 11:35:46.827564 15346 rpcz_store.cc:276] 0929 11:35:45.747636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.685220 (+937584us) service_pool.cc:227] Handling call
0929 11:35:46.696188 (+ 10968us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.696358 (+ 170us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.789701 (+ 93343us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.826681 (+ 36980us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.827133 (+ 452us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.815171 15553 ts_tablet_manager.cc:1428] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.063s user 0.004s sys 0.003s
I20260929 11:35:46.830381 15349 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 47) took 1085 ms. Trace:
I20260929 11:35:46.831008 15579 raft_consensus.cc:2781] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:46.832007 15579 raft_consensus.cc:482] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:46.832392 15579 raft_consensus.cc:3037] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:46.833948 15354 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 58) took 1084 ms. Trace:
I20260929 11:35:46.834403 15354 rpcz_store.cc:276] 0929 11:35:45.749174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.810166 (+1060992us) service_pool.cc:227] Handling call
0929 11:35:46.812346 (+ 2180us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.812442 (+ 96us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.822519 (+ 10077us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.833460 (+ 10941us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.833888 (+ 428us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.798914 15502 rpcz_store.cc:276] 0929 11:35:45.356689 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.473649 (+1116960us) service_pool.cc:227] Handling call
0929 11:35:46.512833 (+ 39184us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.512930 (+ 97us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.618552 (+105622us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.798000 (+179448us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.798412 (+ 412us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.835994 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 49) took 1089 ms. Trace:
I20260929 11:35:46.837898 15348 rpcz_store.cc:276] 0929 11:35:45.746252 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.616199 (+869947us) service_pool.cc:227] Handling call
0929 11:35:46.619398 (+ 3199us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.619512 (+ 114us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.781942 (+162430us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.835487 (+ 53545us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.835940 (+ 453us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.840112 15579 raft_consensus.cc:504] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.807377 15555 raft_consensus.cc:348] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.842031 15555 raft_consensus.cc:374] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.842329 15555 raft_consensus.cc:729] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.843029 15555 consensus_queue.cc:260] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.843925 15351 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 52) took 1096 ms. Trace:
I20260929 11:35:46.845232 15555 ts_tablet_manager.cc:1428] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.040s user 0.005s sys 0.001s
I20260929 11:35:46.846220 15555 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:46.841673 15349 rpcz_store.cc:276] 0929 11:35:45.745563 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.539084 (+793521us) service_pool.cc:227] Handling call
0929 11:35:46.644691 (+105607us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.644785 (+ 94us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.723802 (+ 79017us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.828688 (+104886us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.830324 (+ 1636us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.831501 15352 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 51) took 1084 ms. Trace:
I20260929 11:35:46.851202 15553 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:46.857319 15579 leader_election.cc:288] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:46.858081 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:46.858983 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
W20260929 11:35:46.859460 15476 leader_election.cc:341] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.859601 15439 raft_consensus.cc:3037] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:46.860109 15347 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 57) took 1111 ms. Trace:
I20260929 11:35:46.829311 15554 raft_consensus.cc:348] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.861425 15554 raft_consensus.cc:374] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.862264 15554 raft_consensus.cc:729] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.863032 15554 consensus_queue.cc:260] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.860500 15347 rpcz_store.cc:276] 0929 11:35:45.748893 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.791510 (+1042617us) service_pool.cc:227] Handling call
0929 11:35:46.811278 (+ 19768us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.811439 (+ 161us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.836037 (+ 24598us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.859563 (+ 23526us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.860034 (+ 471us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.865396 15554 ts_tablet_manager.cc:1428] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.039s user 0.007s sys 0.000s
I20260929 11:35:46.866397 15554 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:46.867198 15345 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 50) took 1120 ms. Trace:
I20260929 11:35:46.867599 15345 rpcz_store.cc:276] 0929 11:35:45.746642 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.625774 (+879132us) service_pool.cc:227] Handling call
0929 11:35:46.651929 (+ 26155us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.652025 (+ 96us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.823194 (+171169us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.866683 (+ 43489us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.867135 (+ 452us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.870025 15350 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 55) took 1121 ms. Trace:
I20260929 11:35:46.870455 15350 rpcz_store.cc:276] 0929 11:35:45.748221 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.713635 (+965414us) service_pool.cc:227] Handling call
0929 11:35:46.715418 (+ 1783us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.715514 (+ 96us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.794475 (+ 78961us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.869184 (+ 74709us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.869745 (+ 561us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.852069 15351 rpcz_store.cc:276] 0929 11:35:45.747248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.638293 (+891045us) service_pool.cc:227] Handling call
0929 11:35:46.640022 (+ 1729us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.640225 (+ 203us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.734404 (+ 94179us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.843413 (+109009us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.843863 (+ 450us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.873322 15554 tablet_bootstrap.cc:654] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.875883 15553 tablet_bootstrap.cc:654] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.851753 15352 rpcz_store.cc:276] 0929 11:35:45.746941 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.628779 (+881838us) service_pool.cc:227] Handling call
0929 11:35:46.671337 (+ 42558us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.671435 (+ 98us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.718847 (+ 47412us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.831019 (+112172us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.831443 (+ 424us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.877570 15555 tablet_bootstrap.cc:654] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.877501 15427 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49358 (request call id 58) took 1513 ms. Trace:
I20260929 11:35:46.878072 15439 raft_consensus.cc:2454] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:46.879531 15427 rpcz_store.cc:276] 0929 11:35:45.364477 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.699891 (+1335414us) service_pool.cc:227] Handling call
0929 11:35:46.777371 (+ 77480us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.777512 (+ 141us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.843205 (+ 65693us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.876968 (+ 33763us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.877434 (+ 466us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.881126 15478 leader_election.cc:302] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters: 79f6b689389549ce8079ff46fd514467
I20260929 11:35:46.881832 15579 raft_consensus.cc:2781] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:46.882524 15579 raft_consensus.cc:686] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:46.883476 15579 consensus_queue.cc:237] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.887033 15558 raft_consensus.cc:482] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:46.887563 15558 raft_consensus.cc:504] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.891053 15558 leader_election.cc:288] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:46.893429 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b927b471cd474c88c32acd488f0492" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:46.893764 15554 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:46.894436 15554 ts_tablet_manager.cc:1397] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.002s
I20260929 11:35:46.894631 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b927b471cd474c88c32acd488f0492" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:46.896036 15261 catalog_manager.cc:5495] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:46.898278 15554 raft_consensus.cc:348] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:46.896054 15404 leader_election.cc:341] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.899307 15558 raft_consensus.cc:482] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:46.899343 15554 raft_consensus.cc:374] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 11:35:46.899611 15402 leader_election.cc:341] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.899993 15554 raft_consensus.cc:729] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.899962 15558 raft_consensus.cc:504] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.902490 15402 leader_election.cc:302] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:46.902757 15558 leader_election.cc:288] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:46.901273 15554 consensus_queue.cc:260] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.904316 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:46.905081 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:46.905421 15554 ts_tablet_manager.cc:1428] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260929 11:35:46.906386 15554 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
W20260929 11:35:46.906258 15404 leader_election.cc:341] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:46.907102 15402 leader_election.cc:341] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.907718 15402 leader_election.cc:302] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:46.907685 15558 raft_consensus.cc:2726] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:46.909617 15558 raft_consensus.cc:2726] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:46.913580 15353 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41830 (request call id 54) took 1165 ms. Trace:
I20260929 11:35:46.913968 15353 rpcz_store.cc:276] 0929 11:35:45.747934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.710095 (+962161us) service_pool.cc:227] Handling call
0929 11:35:46.756863 (+ 46768us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.757002 (+ 139us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.846217 (+ 89215us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.908595 (+ 62378us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.913515 (+ 4920us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.911999 15495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47180 (request call id 58) took 1536 ms. Trace:
I20260929 11:35:46.916469 15555 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:46.916957 15555 ts_tablet_manager.cc:1397] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.004s
I20260929 11:35:46.916637 15495 rpcz_store.cc:276] 0929 11:35:45.375653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:35:46.643089 (+1267436us) service_pool.cc:227] Handling call
0929 11:35:46.700771 (+ 57682us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:35:46.700900 (+ 129us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:35:46.869717 (+168817us) tablet_metadata.cc:641] Metadata flushed
0929 11:35:46.911334 (+ 41617us) tablet_replica.cc:205] Creating consensus instance
0929 11:35:46.911924 (+ 590us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:35:46.919799 15555 raft_consensus.cc:348] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.921372 15555 raft_consensus.cc:374] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.921681 15555 raft_consensus.cc:729] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.922482 15555 consensus_queue.cc:260] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.924885 15555 ts_tablet_manager.cc:1428] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260929 11:35:46.925711 15554 tablet_bootstrap.cc:654] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.927258 15553 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:46.927739 15553 ts_tablet_manager.cc:1397] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.077s user 0.023s sys 0.027s
I20260929 11:35:46.929358 15555 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:46.931211 15553 raft_consensus.cc:348] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.932222 15553 raft_consensus.cc:374] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.932626 15553 raft_consensus.cc:729] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.933671 15553 consensus_queue.cc:260] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.936192 15553 ts_tablet_manager.cc:1428] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260929 11:35:46.937784 15555 tablet_bootstrap.cc:654] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.938840 15553 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:46.943549 15554 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:46.944108 15554 ts_tablet_manager.cc:1397] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.038s user 0.013s sys 0.008s
I20260929 11:35:46.945408 15553 tablet_bootstrap.cc:654] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.947028 15554 raft_consensus.cc:348] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.947853 15554 raft_consensus.cc:374] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.948210 15554 raft_consensus.cc:729] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.949241 15554 consensus_queue.cc:260] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.952491 15554 ts_tablet_manager.cc:1428] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260929 11:35:46.953877 15554 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:46.962282 15554 tablet_bootstrap.cc:654] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.964347 15553 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:46.965131 15553 ts_tablet_manager.cc:1397] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.026s user 0.018s sys 0.007s
I20260929 11:35:46.968845 15553 raft_consensus.cc:348] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.969995 15553 raft_consensus.cc:374] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:46.970679 15553 raft_consensus.cc:729] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:46.971794 15553 consensus_queue.cc:260] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.980509 15553 ts_tablet_manager.cc:1428] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.015s user 0.009s sys 0.000s
I20260929 11:35:46.982049 15553 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:46.990656 15553 tablet_bootstrap.cc:654] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:46.990760 15579 raft_consensus.cc:482] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:46.991369 15579 raft_consensus.cc:504] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:46.993491 15579 leader_election.cc:288] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:46.995137 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d952461bcb418b8e68f4389e815978" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
W20260929 11:35:46.996840 15476 leader_election.cc:341] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.997689 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d952461bcb418b8e68f4389e815978" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:46.999169 15478 leader_election.cc:341] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:46.999627 15478 leader_election.cc:302] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:47.000169 15554 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:47.000355 15579 raft_consensus.cc:2726] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.000684 15554 ts_tablet_manager.cc:1397] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.047s user 0.028s sys 0.017s
I20260929 11:35:47.001588 15553 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:47.002048 15553 ts_tablet_manager.cc:1397] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.003s
I20260929 11:35:47.002400 15555 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.002790 15555 ts_tablet_manager.cc:1397] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.074s user 0.020s sys 0.030s
I20260929 11:35:47.003458 15554 raft_consensus.cc:348] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.004209 15554 raft_consensus.cc:374] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.004522 15554 raft_consensus.cc:729] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.004623 15553 raft_consensus.cc:348] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.004962 15555 raft_consensus.cc:348] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.005354 15553 raft_consensus.cc:374] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.005601 15555 raft_consensus.cc:374] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.005788 15553 raft_consensus.cc:729] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.005318 15554 consensus_queue.cc:260] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.005931 15555 raft_consensus.cc:729] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.006536 15553 consensus_queue.cc:260] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.007021 15555 consensus_queue.cc:260] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.007740 15554 ts_tablet_manager.cc:1428] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.007s user 0.003s sys 0.001s
I20260929 11:35:47.009053 15553 ts_tablet_manager.cc:1428] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260929 11:35:47.009157 15554 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:47.010185 15553 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:47.011837 15555 ts_tablet_manager.cc:1428] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260929 11:35:47.012820 15555 tablet_bootstrap.cc:492] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.015862 15553 tablet_bootstrap.cc:654] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.015862 15554 tablet_bootstrap.cc:654] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.018682 15555 tablet_bootstrap.cc:654] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.028136 15588 raft_consensus.cc:482] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.028877 15588 raft_consensus.cc:504] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.030232 15555 tablet_bootstrap.cc:492] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.030733 15555 ts_tablet_manager.cc:1397] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.009s
I20260929 11:35:47.033110 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3076393f65ab418199a711fc32bd3818" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.033763 15555 raft_consensus.cc:348] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.034529 15555 raft_consensus.cc:374] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.034816 15555 raft_consensus.cc:729] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.035486 15555 consensus_queue.cc:260] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.035737 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3076393f65ab418199a711fc32bd3818" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.037107 15561 raft_consensus.cc:482] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:35:47.037621 15404 leader_election.cc:341] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.037564 15561 raft_consensus.cc:504] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:47.039091 15402 leader_election.cc:341] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.039516 15402 leader_election.cc:302] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:47.039521 15561 leader_election.cc:288] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.040584 15558 raft_consensus.cc:2726] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.040843 15588 leader_election.cc:288] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.042660 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.043355 15555 ts_tablet_manager.cc:1428] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260929 11:35:47.044406 15555 tablet_bootstrap.cc:492] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
W20260929 11:35:47.044579 15329 leader_election.cc:341] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.045318 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.045981 15513 raft_consensus.cc:2454] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.047175 15329 leader_election.cc:302] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:47.048380 15561 raft_consensus.cc:2781] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.048736 15561 raft_consensus.cc:482] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.049077 15561 raft_consensus.cc:3037] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.050733 15555 tablet_bootstrap.cc:654] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.065090 15555 tablet_bootstrap.cc:492] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.065594 15555 ts_tablet_manager.cc:1397] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.021s user 0.013s sys 0.003s
I20260929 11:35:47.068169 15555 raft_consensus.cc:348] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.068930 15555 raft_consensus.cc:374] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.069208 15555 raft_consensus.cc:729] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.070079 15555 consensus_queue.cc:260] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.078689 15561 raft_consensus.cc:504] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.079259 15555 ts_tablet_manager.cc:1428] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.013s user 0.006s sys 0.007s
I20260929 11:35:47.080219 15555 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.081667 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
W20260929 11:35:47.083086 15329 leader_election.cc:341] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.085287 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.085883 15513 raft_consensus.cc:3037] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.086304 15555 tablet_bootstrap.cc:654] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.097889 15555 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.098352 15555 ts_tablet_manager.cc:1397] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.012s
I20260929 11:35:47.101375 15513 raft_consensus.cc:2454] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.105634 15329 leader_election.cc:302] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:47.102531 15561 leader_election.cc:288] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.103331 15555 raft_consensus.cc:348] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.106660 15601 raft_consensus.cc:2781] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.107026 15555 raft_consensus.cc:374] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.107304 15555 raft_consensus.cc:729] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.107932 15555 consensus_queue.cc:260] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.110200 15555 ts_tablet_manager.cc:1428] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20260929 11:35:47.111377 15555 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.107894 15553 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:47.112852 15553 ts_tablet_manager.cc:1397] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.103s user 0.027s sys 0.047s
I20260929 11:35:47.113914 15554 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:47.114459 15554 ts_tablet_manager.cc:1397] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.105s user 0.025s sys 0.064s
I20260929 11:35:47.115319 15553 raft_consensus.cc:348] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.115897 15553 raft_consensus.cc:374] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.116210 15553 raft_consensus.cc:729] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.116833 15555 tablet_bootstrap.cc:654] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.117022 15601 raft_consensus.cc:686] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:47.116935 15554 raft_consensus.cc:348] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.116909 15553 consensus_queue.cc:260] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.117937 15554 raft_consensus.cc:374] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.118350 15554 raft_consensus.cc:729] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.118063 15601 consensus_queue.cc:237] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.119418 15553 ts_tablet_manager.cc:1428] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260929 11:35:47.119031 15554 consensus_queue.cc:260] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.121408 15554 ts_tablet_manager.cc:1428] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260929 11:35:47.127122 15554 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:47.134603 15554 tablet_bootstrap.cc:654] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.137357 15260 catalog_manager.cc:5495] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:47.138994 15553 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:47.148730 15553 tablet_bootstrap.cc:654] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.162040 15601 raft_consensus.cc:482] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.162942 15555 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.163470 15555 ts_tablet_manager.cc:1397] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.052s user 0.021s sys 0.026s
I20260929 11:35:47.162824 15601 raft_consensus.cc:504] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.165843 15555 raft_consensus.cc:348] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.166599 15555 raft_consensus.cc:374] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.166905 15555 raft_consensus.cc:729] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.166960 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.167608 15439 raft_consensus.cc:2454] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.167917 15553 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:47.167577 15555 consensus_queue.cc:260] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.167934 15554 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:47.168500 15553 ts_tablet_manager.cc:1397] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.030s user 0.023s sys 0.000s
I20260929 11:35:47.168638 15554 ts_tablet_manager.cc:1397] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.042s user 0.021s sys 0.015s
I20260929 11:35:47.169107 15329 leader_election.cc:302] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:47.170028 15603 raft_consensus.cc:2781] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.170367 15603 raft_consensus.cc:482] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.170648 15603 raft_consensus.cc:3037] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.173346 15555 ts_tablet_manager.cc:1428] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260929 11:35:47.174294 15555 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.174613 15601 leader_election.cc:288] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.175925 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.176607 15513 raft_consensus.cc:2454] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.179653 15603 raft_consensus.cc:504] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.181214 15555 tablet_bootstrap.cc:654] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.180979 15554 raft_consensus.cc:348] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.181564 15603 leader_election.cc:288] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.181694 15554 raft_consensus.cc:374] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.182046 15554 raft_consensus.cc:729] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.182906 15553 raft_consensus.cc:348] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.183000 15554 consensus_queue.cc:260] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.183636 15553 raft_consensus.cc:374] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.184304 15553 raft_consensus.cc:729] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.185135 15554 ts_tablet_manager.cc:1428] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260929 11:35:47.185026 15553 consensus_queue.cc:260] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.186767 15554 tablet_bootstrap.cc:492] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:47.192305 15553 ts_tablet_manager.cc:1428] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260929 11:35:47.192812 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.193280 15553 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:47.193385 15513 raft_consensus.cc:3037] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.194846 15554 tablet_bootstrap.cc:654] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.199079 15553 tablet_bootstrap.cc:654] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.203845 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.205241 15439 raft_consensus.cc:3037] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.206522 15588 raft_consensus.cc:482] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.206991 15588 raft_consensus.cc:504] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.208947 15588 leader_election.cc:288] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.210886 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.211355 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
W20260929 11:35:47.213182 15404 leader_election.cc:341] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:47.213995 15402 leader_election.cc:341] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.214406 15402 leader_election.cc:302] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:47.215560 15588 raft_consensus.cc:2726] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.220432 15553 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:47.220994 15553 ts_tablet_manager.cc:1397] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.028s user 0.011s sys 0.006s
I20260929 11:35:47.224041 15553 raft_consensus.cc:348] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.224933 15553 raft_consensus.cc:374] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.225236 15553 raft_consensus.cc:729] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.225972 15553 consensus_queue.cc:260] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.228191 15553 ts_tablet_manager.cc:1428] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260929 11:35:47.229457 15513 raft_consensus.cc:2454] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.229679 15553 tablet_bootstrap.cc:492] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:47.230604 15329 leader_election.cc:302] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:47.231329 15603 raft_consensus.cc:2781] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.231781 15603 raft_consensus.cc:686] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:47.232544 15603 consensus_queue.cc:237] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.236418 15601 raft_consensus.cc:482] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.236893 15601 raft_consensus.cc:504] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.238865 15601 leader_election.cc:288] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.241421 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5471502e24764effae2ab947ad5c8cb5" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.243193 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5471502e24764effae2ab947ad5c8cb5" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.244020 15512 raft_consensus.cc:2454] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.244652 15439 raft_consensus.cc:2454] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.246501 15329 leader_election.cc:302] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:47.247373 15601 raft_consensus.cc:2781] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260929 11:35:47.247519 15329 leader_election.cc:341] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.247802 15601 raft_consensus.cc:482] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.248260 15601 raft_consensus.cc:3037] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.249816 15555 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.250316 15553 tablet_bootstrap.cc:654] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.250466 15555 ts_tablet_manager.cc:1397] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.076s user 0.041s sys 0.030s
I20260929 11:35:47.251014 15554 tablet_bootstrap.cc:492] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:47.251461 15554 ts_tablet_manager.cc:1397] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.065s user 0.017s sys 0.029s
I20260929 11:35:47.252286 15561 raft_consensus.cc:482] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.252737 15561 raft_consensus.cc:504] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.253878 15555 raft_consensus.cc:348] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.254047 15554 raft_consensus.cc:348] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.254591 15555 raft_consensus.cc:374] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.254743 15554 raft_consensus.cc:374] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.255151 15555 raft_consensus.cc:729] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.255172 15554 raft_consensus.cc:729] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.254639 15561 leader_election.cc:288] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.255959 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.256033 15601 raft_consensus.cc:504] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.256028 15555 consensus_queue.cc:260] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.256649 15554 consensus_queue.cc:260] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.257098 15439 raft_consensus.cc:2454] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.258291 15601 leader_election.cc:288] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.258565 15555 ts_tablet_manager.cc:1428] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260929 11:35:47.259259 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.259532 15555 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.259910 15512 raft_consensus.cc:2454] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.259945 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5471502e24764effae2ab947ad5c8cb5" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.262816 15554 ts_tablet_manager.cc:1428] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260929 11:35:47.262720 15329 leader_election.cc:302] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:47.263743 15554 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
W20260929 11:35:47.263701 15329 leader_election.cc:341] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.266183 15555 tablet_bootstrap.cc:654] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.266063 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5471502e24764effae2ab947ad5c8cb5" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.266706 15512 raft_consensus.cc:3037] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.275316 15554 tablet_bootstrap.cc:654] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.280422 15512 raft_consensus.cc:2454] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.279480 15258 catalog_manager.cc:5495] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:47.282588 15329 leader_election.cc:302] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:47.284108 15603 raft_consensus.cc:2781] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.285024 15603 raft_consensus.cc:686] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:47.286116 15603 consensus_queue.cc:237] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.281049 15555 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.288785 15555 ts_tablet_manager.cc:1397] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.029s user 0.019s sys 0.002s
I20260929 11:35:47.281168 15601 raft_consensus.cc:2781] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.289223 15601 raft_consensus.cc:482] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.289774 15601 raft_consensus.cc:3037] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.291419 15553 tablet_bootstrap.cc:492] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:47.291850 15553 ts_tablet_manager.cc:1397] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.062s user 0.011s sys 0.004s
I20260929 11:35:47.291693 15555 raft_consensus.cc:348] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.301985 15555 raft_consensus.cc:374] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.302362 15555 raft_consensus.cc:729] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.301884 15553 raft_consensus.cc:348] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.303335 15553 raft_consensus.cc:374] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.303040 15555 consensus_queue.cc:260] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:47.304404 15476 consensus_peers.cc:487] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:47.305560 15555 ts_tablet_manager.cc:1428] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.016s user 0.002s sys 0.013s
I20260929 11:35:47.307018 15555 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.303599 15553 raft_consensus.cc:729] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.308856 15553 consensus_queue.cc:260] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.310941 15553 ts_tablet_manager.cc:1428] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.019s user 0.000s sys 0.009s
I20260929 11:35:47.313138 15553 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:47.313195 15555 tablet_bootstrap.cc:654] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.315119 15554 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:47.315611 15554 ts_tablet_manager.cc:1397] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.052s user 0.018s sys 0.013s
I20260929 11:35:47.315660 15601 raft_consensus.cc:504] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.319001 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.319598 15439 raft_consensus.cc:3037] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.319814 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.320556 15512 raft_consensus.cc:3037] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.319926 15260 catalog_manager.cc:5495] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:47.325928 15554 raft_consensus.cc:348] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.327134 15554 raft_consensus.cc:374] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.327417 15553 tablet_bootstrap.cc:654] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.327479 15554 raft_consensus.cc:729] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.328286 15554 consensus_queue.cc:260] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.330415 15555 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.330431 15554 ts_tablet_manager.cc:1428] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.014s user 0.000s sys 0.005s
I20260929 11:35:47.330981 15555 ts_tablet_manager.cc:1397] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.007s
I20260929 11:35:47.333968 15555 raft_consensus.cc:348] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.334650 15555 raft_consensus.cc:374] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.334890 15555 raft_consensus.cc:729] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.335454 15555 consensus_queue.cc:260] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.336220 15588 raft_consensus.cc:482] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.336383 15512 raft_consensus.cc:2454] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.336704 15588 raft_consensus.cc:504] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.337594 15329 leader_election.cc:302] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:47.338922 15603 raft_consensus.cc:2781] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.339408 15603 raft_consensus.cc:686] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:47.339349 15439 raft_consensus.cc:2454] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.340623 15588 leader_election.cc:288] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.340358 15603 consensus_queue.cc:237] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.319039 15601 leader_election.cc:288] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.342108 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40592b40c49441e1a1bb2e582199b023" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.342729 15512 raft_consensus.cc:2454] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:47.340380 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40592b40c49441e1a1bb2e582199b023" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.343434 15364 raft_consensus.cc:2454] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:47.344887 15404 leader_election.cc:302] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:47.346221 15555 ts_tablet_manager.cc:1428] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260929 11:35:47.347043 15555 tablet_bootstrap.cc:492] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.348912 15554 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:47.350137 15588 raft_consensus.cc:2781] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.350575 15588 raft_consensus.cc:482] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.350922 15588 raft_consensus.cc:3037] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.352622 15555 tablet_bootstrap.cc:654] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.356158 15554 tablet_bootstrap.cc:654] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.358989 15588 raft_consensus.cc:504] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.359980 15555 tablet_bootstrap.cc:492] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.360287 15553 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:47.360441 15555 ts_tablet_manager.cc:1397] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.002s
I20260929 11:35:47.360718 15553 ts_tablet_manager.cc:1397] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.048s user 0.012s sys 0.005s
I20260929 11:35:47.361789 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40592b40c49441e1a1bb2e582199b023" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:47.362350 15364 raft_consensus.cc:3037] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.363077 15553 raft_consensus.cc:348] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.362848 15555 raft_consensus.cc:348] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.363722 15553 raft_consensus.cc:374] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.363950 15555 raft_consensus.cc:374] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.363993 15553 raft_consensus.cc:729] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.364398 15555 raft_consensus.cc:729] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.364981 15553 consensus_queue.cc:260] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.365043 15555 consensus_queue.cc:260] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.366916 15554 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:47.367218 15555 ts_tablet_manager.cc:1428] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260929 11:35:47.367379 15554 ts_tablet_manager.cc:1397] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.006s
I20260929 11:35:47.368110 15555 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.369897 15364 raft_consensus.cc:2454] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:47.370823 15554 raft_consensus.cc:348] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.371606 15554 raft_consensus.cc:374] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.371917 15554 raft_consensus.cc:729] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.371762 15402 leader_election.cc:302] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:47.372921 15558 raft_consensus.cc:2781] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.372677 15554 consensus_queue.cc:260] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.374843 15554 ts_tablet_manager.cc:1428] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260929 11:35:47.375676 15555 tablet_bootstrap.cc:654] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.375821 15553 ts_tablet_manager.cc:1428] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.015s user 0.003s sys 0.002s
I20260929 11:35:47.375973 15554 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:47.380868 15579 raft_consensus.cc:482] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.381500 15579 raft_consensus.cc:504] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.383085 15554 tablet_bootstrap.cc:654] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.384076 15579 leader_election.cc:288] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.385231 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.385926 15363 raft_consensus.cc:2454] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:47.387470 15476 leader_election.cc:302] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:47.389066 15579 raft_consensus.cc:2781] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.389536 15579 raft_consensus.cc:482] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.389955 15579 raft_consensus.cc:3037] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.391525 15621 raft_consensus.cc:482] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.392098 15558 raft_consensus.cc:686] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:47.399044 15558 consensus_queue.cc:237] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.396983 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40592b40c49441e1a1bb2e582199b023" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.406838 15512 raft_consensus.cc:3037] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.409587 15553 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:47.408025 15579 raft_consensus.cc:504] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.419332 15512 raft_consensus.cc:2454] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:47.397679 15588 leader_election.cc:288] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.426827 15588 raft_consensus.cc:482] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.427526 15588 raft_consensus.cc:504] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.402503 15603 raft_consensus.cc:482] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.429227 15603 raft_consensus.cc:504] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.431792 15603 leader_election.cc:288] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.432013 15621 raft_consensus.cc:504] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.434134 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d952461bcb418b8e68f4389e815978" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:47.436070 15329 leader_election.cc:341] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.436628 15621 leader_election.cc:288] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.436794 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.444998 15513 raft_consensus.cc:2379] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:47.445979 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f969b15260af489b992eeca4080e55ed" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.393464 15260 catalog_manager.cc:5495] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:47.438035 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.447783 15363 raft_consensus.cc:2454] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:47.448501 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.449325 15439 raft_consensus.cc:2454] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:47.449554 15402 leader_election.cc:302] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:47.438891 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f969b15260af489b992eeca4080e55ed" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.439596 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d952461bcb418b8e68f4389e815978" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.454733 15511 raft_consensus.cc:2454] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.455916 15329 leader_election.cc:302] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:47.457013 15603 raft_consensus.cc:2781] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.457373 15603 raft_consensus.cc:482] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.457703 15603 raft_consensus.cc:3037] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.460707 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:47.461443 15363 raft_consensus.cc:3037] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.462498 15558 raft_consensus.cc:2781] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.472707 15558 raft_consensus.cc:482] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.473219 15558 raft_consensus.cc:3037] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.446949 15364 raft_consensus.cc:2454] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:47.464452 15627 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:47.454345 15512 raft_consensus.cc:2454] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:47.481693 15402 leader_election.cc:302] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:47.482205 15621 raft_consensus.cc:482] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.482882 15621 raft_consensus.cc:504] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.484072 15622 raft_consensus.cc:2781] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.485904 15603 raft_consensus.cc:504] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.486608 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9bdacdc58094518aa9198105dee0e0b" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.488894 15621 leader_election.cc:288] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.488955 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.441354 15588 leader_election.cc:288] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.493760 15555 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
W20260929 11:35:47.494267 15402 leader_election.cc:341] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.495548 15553 tablet_bootstrap.cc:654] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.495340 15555 ts_tablet_manager.cc:1397] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.127s user 0.061s sys 0.041s
I20260929 11:35:47.490198 15622 raft_consensus.cc:482] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.490346 15579 leader_election.cc:288] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.494457 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9bdacdc58094518aa9198105dee0e0b" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.500936 15622 raft_consensus.cc:3037] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.498706 15260 catalog_manager.cc:5495] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:47.502847 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d952461bcb418b8e68f4389e815978" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
W20260929 11:35:47.504765 15329 leader_election.cc:341] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.507296 15601 raft_consensus.cc:482] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.507885 15601 raft_consensus.cc:504] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.508569 15603 leader_election.cc:288] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.510360 15601 leader_election.cc:288] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.510896 15555 raft_consensus.cc:348] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.511569 15555 raft_consensus.cc:374] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.511832 15555 raft_consensus.cc:729] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.507555 15363 raft_consensus.cc:2454] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:47.512951 15555 consensus_queue.cc:260] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.515208 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d952461bcb418b8e68f4389e815978" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.515589 15555 ts_tablet_manager.cc:1428] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.019s user 0.005s sys 0.001s
I20260929 11:35:47.516690 15555 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.516091 15511 raft_consensus.cc:3037] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.521958 15476 leader_election.cc:302] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:47.523483 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "290cd2101f81472384670fdea31eaaf6" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.524240 15555 tablet_bootstrap.cc:654] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.525044 15579 raft_consensus.cc:2781] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.525985 15579 raft_consensus.cc:686] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:47.526503 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "290cd2101f81472384670fdea31eaaf6" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.526827 15579 consensus_queue.cc:237] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:47.530100 15329 leader_election.cc:341] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:47.531955 15329 leader_election.cc:341] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.532636 15329 leader_election.cc:302] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:47.534933 15601 raft_consensus.cc:2726] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.531160 15621 raft_consensus.cc:482] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.540892 15554 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:47.541335 15554 ts_tablet_manager.cc:1397] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.166s user 0.037s sys 0.064s
W20260929 11:35:47.537268 15404 leader_election.cc:341] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.546444 15622 raft_consensus.cc:504] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.546991 15404 leader_election.cc:302] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:47.549995 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f969b15260af489b992eeca4080e55ed" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:47.551028 15363 raft_consensus.cc:3037] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.543874 15621 raft_consensus.cc:504] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.558928 15601 raft_consensus.cc:482] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.559473 15601 raft_consensus.cc:504] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.558856 15260 catalog_manager.cc:5495] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:47.561445 15622 leader_election.cc:288] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.565263 15363 raft_consensus.cc:2454] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:47.566432 15511 raft_consensus.cc:2454] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.568264 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f969b15260af489b992eeca4080e55ed" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.576146 15579 raft_consensus.cc:482] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.607860 15579 raft_consensus.cc:504] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.610966 15512 raft_consensus.cc:3037] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.630095 15561 raft_consensus.cc:482] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.630787 15561 raft_consensus.cc:504] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.633534 15561 leader_election.cc:288] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.642302 15402 leader_election.cc:302] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:47.642714 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.643236 15622 raft_consensus.cc:2781] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.643344 15437 raft_consensus.cc:2454] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.643736 15622 raft_consensus.cc:686] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:47.643918 15554 raft_consensus.cc:348] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.644682 15554 raft_consensus.cc:374] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.645030 15554 raft_consensus.cc:729] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.645010 15622 consensus_queue.cc:237] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.646124 15554 consensus_queue.cc:260] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.649781 15329 leader_election.cc:302] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:47.650713 15561 raft_consensus.cc:2781] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.651149 15561 raft_consensus.cc:482] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.651463 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20bfb5db2aab4679856838ec11feffc9" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.651799 15561 raft_consensus.cc:3037] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.652555 15626 raft_consensus.cc:482] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:35:47.652751 15402 leader_election.cc:341] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.653034 15626 raft_consensus.cc:504] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.656193 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20bfb5db2aab4679856838ec11feffc9" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:47.657994 15404 leader_election.cc:341] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.659055 15404 leader_election.cc:302] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:47.662106 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809d1abd25d74defa0a2869d15a553b7" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.663335 15621 leader_election.cc:288] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.588927 15603 raft_consensus.cc:482] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.663717 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9bdacdc58094518aa9198105dee0e0b" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.664614 15621 raft_consensus.cc:2726] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.594220 15627 raft_consensus.cc:482] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.559490 15588 raft_consensus.cc:2726] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.664278 15603 raft_consensus.cc:504] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.665211 15627 raft_consensus.cc:504] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.666550 15603 leader_election.cc:288] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.667950 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:47.669286 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:47.669966 15554 ts_tablet_manager.cc:1428] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.128s user 0.020s sys 0.027s
W20260929 11:35:47.670339 15476 leader_election.cc:341] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:47.671252 15476 leader_election.cc:341] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.587951 15558 raft_consensus.cc:504] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.673499 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.674167 15438 raft_consensus.cc:2379] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 2b2ed85c4da64515a0664b6c0421e078 in this term.
I20260929 11:35:47.680137 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:47.681082 15362 raft_consensus.cc:2379] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:47.683473 15601 leader_election.cc:288] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.685395 15554 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:47.685700 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.687106 15404 leader_election.cc:302] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:47.687855 15627 leader_election.cc:288] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.688203 15621 raft_consensus.cc:2726] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.688709 15558 leader_election.cc:288] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.694959 15553 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:47.697295 15555 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.697810 15555 ts_tablet_manager.cc:1397] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.181s user 0.011s sys 0.001s
I20260929 11:35:47.695474 15553 ts_tablet_manager.cc:1397] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.286s user 0.017s sys 0.039s
I20260929 11:35:47.700603 15555 raft_consensus.cc:348] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.701558 15555 raft_consensus.cc:374] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.701851 15555 raft_consensus.cc:729] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.702594 15555 consensus_queue.cc:260] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.690753 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.703621 15437 raft_consensus.cc:2454] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:47.691977 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.705119 15435 raft_consensus.cc:2454] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:47.706312 15478 leader_election.cc:302] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:47.706517 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3076393f65ab418199a711fc32bd3818" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.690855 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9bdacdc58094518aa9198105dee0e0b" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.707513 15627 raft_consensus.cc:2781] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.707698 15436 raft_consensus.cc:2454] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:47.707878 15627 raft_consensus.cc:482] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.708253 15627 raft_consensus.cc:3037] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.692540 15626 leader_election.cc:288] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.691044 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809d1abd25d74defa0a2869d15a553b7" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.689522 15579 leader_election.cc:288] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.693058 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3076393f65ab418199a711fc32bd3818" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.709851 15478 leader_election.cc:302] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters: 79f6b689389549ce8079ff46fd514467
I20260929 11:35:47.710146 15434 raft_consensus.cc:2454] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
W20260929 11:35:47.711333 15478 leader_election.cc:341] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.711731 15478 leader_election.cc:302] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:47.712659 15626 raft_consensus.cc:2781] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.712997 15626 raft_consensus.cc:482] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.702773 15553 raft_consensus.cc:348] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.713588 15553 raft_consensus.cc:374] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.714152 15512 raft_consensus.cc:2454] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:47.695007 15329 leader_election.cc:302] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:47.713295 15626 raft_consensus.cc:3037] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.715806 15555 ts_tablet_manager.cc:1428] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260929 11:35:47.719592 15555 tablet_bootstrap.cc:492] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:47.713892 15553 raft_consensus.cc:729] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.691931 15554 tablet_bootstrap.cc:654] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.722745 15553 consensus_queue.cc:260] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.724466 15258 catalog_manager.cc:5495] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
W20260929 11:35:47.725314 15329 leader_election.cc:341] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:47.726147 15329 leader_election.cc:341] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.726608 15553 ts_tablet_manager.cc:1428] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.026s user 0.005s sys 0.001s
I20260929 11:35:47.727141 15601 raft_consensus.cc:2781] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.727501 15553 tablet_bootstrap.cc:492] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
W20260929 11:35:47.729127 15329 consensus_peers.cc:487] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:47.731487 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:47.733403 15561 raft_consensus.cc:504] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.734938 15364 raft_consensus.cc:2379] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:47.738497 15553 tablet_bootstrap.cc:654] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.739277 15561 leader_election.cc:288] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.743641 15626 raft_consensus.cc:504] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.745540 15554 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:47.729875 15329 leader_election.cc:302] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:47.746080 15554 ts_tablet_manager.cc:1397] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.062s user 0.010s sys 0.004s
I20260929 11:35:47.749806 15555 tablet_bootstrap.cc:654] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.747900 15561 raft_consensus.cc:2781] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.751258 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9bdacdc58094518aa9198105dee0e0b" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:47.754853 15601 raft_consensus.cc:686] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:47.753039 15561 raft_consensus.cc:482] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.752945 15626 leader_election.cc:288] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.751987 15329 leader_election.cc:302] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
W20260929 11:35:47.758347 15476 leader_election.cc:341] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.758864 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9bdacdc58094518aa9198105dee0e0b" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.757354 15561 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.759483 15434 raft_consensus.cc:3037] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.759667 15603 raft_consensus.cc:2781] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260929 11:35:47.759063 15329 consensus_peers.cc:487] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:47.761265 15601 consensus_queue.cc:237] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.762629 15554 raft_consensus.cc:348] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.763302 15554 raft_consensus.cc:374] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.763545 15554 raft_consensus.cc:729] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.758262 15635 raft_consensus.cc:2726] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.765969 15627 raft_consensus.cc:504] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.766984 15364 raft_consensus.cc:3037] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.768793 15511 raft_consensus.cc:2379] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79f6b689389549ce8079ff46fd514467 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:47.760047 15603 raft_consensus.cc:482] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.770421 15603 raft_consensus.cc:3037] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.773758 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:47.774551 15363 raft_consensus.cc:2379] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:47.775372 15579 raft_consensus.cc:482] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:47.775993 15579 raft_consensus.cc:504] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.780833 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4188ffe2fdb34c9f9b5349a5aeff90a3" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:47.781528 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.782027 15439 raft_consensus.cc:3037] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:47.784654 15476 leader_election.cc:341] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.788232 15561 raft_consensus.cc:504] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.817548 15561 leader_election.cc:288] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.840365 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.836175 15554 consensus_queue.cc:260] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.845041 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.845655 15435 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.845651 15478 leader_election.cc:302] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:47.846844 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.847800 15635 raft_consensus.cc:2726] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:35:47.849030 15554 ts_tablet_manager.cc:1428] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.102s user 0.014s sys 0.002s
W20260929 11:35:47.855469 15329 leader_election.cc:341] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.836015 15627 leader_election.cc:288] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.858429 15439 raft_consensus.cc:2454] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.840970 15622 consensus_queue.cc:1035] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260929 11:35:47.859970 15329 leader_election.cc:302] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:47.879441 15558 consensus_queue.cc:1035] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:47.856463 15603 raft_consensus.cc:504] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.887877 15603 leader_election.cc:288] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:47.888476 15636 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260929 11:35:47.915217 15553 tablet_bootstrap.cc:492] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:47.915851 15553 ts_tablet_manager.cc:1397] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.189s user 0.014s sys 0.006s
I20260929 11:35:47.896613 15603 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260929 11:35:47.914201 15579 leader_election.cc:288] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.924618 15554 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:47.917830 15641 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260929 11:35:47.929476 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4188ffe2fdb34c9f9b5349a5aeff90a3" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:47.930208 15439 raft_consensus.cc:2454] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:47.923691 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a423a044a6d34d8d86e6a2009617a53c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.931020 15511 raft_consensus.cc:2379] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79f6b689389549ce8079ff46fd514467 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:47.931282 15478 leader_election.cc:302] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters: 79f6b689389549ce8079ff46fd514467
I20260929 11:35:47.932966 15627 raft_consensus.cc:2781] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:47.933333 15627 raft_consensus.cc:482] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:47.933646 15627 raft_consensus.cc:3037] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.918527 15434 raft_consensus.cc:2454] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:47.942051 15435 raft_consensus.cc:2454] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.943701 15478 leader_election.cc:302] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters: 79f6b689389549ce8079ff46fd514467
W20260929 11:35:47.944443 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 84701us
I20260929 11:35:47.930825 15553 raft_consensus.cc:348] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.946588 15634 raft_consensus.cc:2781] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.947103 15634 raft_consensus.cc:686] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:47.947921 15634 consensus_queue.cc:237] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.948398 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3076393f65ab418199a711fc32bd3818" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.949445 15434 raft_consensus.cc:3037] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:47.957641 15553 raft_consensus.cc:374] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:47.958160 15553 raft_consensus.cc:729] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:47.959828 15554 tablet_bootstrap.cc:654] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:47.960192 15579 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:47.960716 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3076393f65ab418199a711fc32bd3818" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:47.964432 15627 raft_consensus.cc:504] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.967329 15553 consensus_queue.cc:260] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.969326 15603 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:47.970837 15555 tablet_bootstrap.cc:492] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:47.970706 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4188ffe2fdb34c9f9b5349a5aeff90a3" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:47.971282 15555 ts_tablet_manager.cc:1397] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.252s user 0.007s sys 0.010s
W20260929 11:35:47.971789 15329 leader_election.cc:341] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.969630 15627 leader_election.cc:288] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:47.979027 15603 consensus_queue.cc:1035] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:47.982554 15553 ts_tablet_manager.cc:1428] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.066s user 0.006s sys 0.002s
I20260929 11:35:47.976960 15640 raft_consensus.cc:2781] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:47.983299 15640 raft_consensus.cc:686] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:47.984186 15640 consensus_queue.cc:237] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:47.985574 15476 leader_election.cc:341] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:47.987450 15553 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:47.967516 15434 raft_consensus.cc:2454] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:47.993872 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4188ffe2fdb34c9f9b5349a5aeff90a3" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:47.995605 15436 raft_consensus.cc:3037] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.014376 15644 raft_consensus.cc:482] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.017489 15260 catalog_manager.cc:5495] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:48.015130 15644 raft_consensus.cc:504] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:47.992758 15329 leader_election.cc:302] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.047079 15603 raft_consensus.cc:2781] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:48.052114 15603 raft_consensus.cc:686] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:48.055665 15603 consensus_queue.cc:237] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.040153 15645 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.071s
I20260929 11:35:48.066781 15555 raft_consensus.cc:348] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.067687 15555 raft_consensus.cc:374] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.067975 15555 raft_consensus.cc:729] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.066075 15634 raft_consensus.cc:482] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.070634 15555 consensus_queue.cc:260] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:48.070111 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 79913.6us
I20260929 11:35:48.077113 15634 raft_consensus.cc:504] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.075749 15621 raft_consensus.cc:482] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.100914 15555 ts_tablet_manager.cc:1428] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.129s user 0.010s sys 0.019s
I20260929 11:35:48.105286 15555 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:48.111661 15621 raft_consensus.cc:504] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.106679 15561 raft_consensus.cc:482] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
I20260929 11:35:48.120790 15561 raft_consensus.cc:504] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.121192 15329 leader_election.cc:302] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.122000 15645 raft_consensus.cc:2781] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:48.122455 15645 raft_consensus.cc:686] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:48.123220 15645 consensus_queue.cc:237] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.129601 15644 leader_election.cc:288] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.103720 15634 leader_election.cc:288] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:35:48.140084 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b927b471cd474c88c32acd488f0492" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:48.140988 15651 log.cc:924] Time spent T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260929 11:35:48.141237 15434 raft_consensus.cc:2454] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:48.157529 15561 leader_election.cc:288] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.158427 15621 leader_election.cc:288] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.136279 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "290cd2101f81472384670fdea31eaaf6" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:48.170444 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d952461bcb418b8e68f4389e815978" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:48.310647 15554 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:48.311261 15554 ts_tablet_manager.cc:1397] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.387s user 0.032s sys 0.043s
I20260929 11:35:48.275592 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b927b471cd474c88c32acd488f0492" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:48.312300 15553 tablet_bootstrap.cc:654] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.167948 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d952461bcb418b8e68f4389e815978" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:48.279342 15436 raft_consensus.cc:2454] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:48.258827 15634 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260929 11:35:48.226444 15329 leader_election.cc:302] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:48.170643 15259 catalog_manager.cc:5495] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:48.329337 15513 raft_consensus.cc:2379] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:48.332872 15555 tablet_bootstrap.cc:654] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:48.321061 15478 leader_election.cc:341] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.206771 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "290cd2101f81472384670fdea31eaaf6" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:48.342589 15621 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:48.344298 15558 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:48.344904 15478 leader_election.cc:302] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters: 79f6b689389549ce8079ff46fd514467
I20260929 11:35:48.346115 15626 raft_consensus.cc:2781] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:48.346601 15626 raft_consensus.cc:686] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:48.347393 15626 consensus_queue.cc:237] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.336633 15641 raft_consensus.cc:2781] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:48.349303 15641 raft_consensus.cc:482] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:48.349728 15641 raft_consensus.cc:3037] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.355019 15404 leader_election.cc:302] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.355506 15554 raft_consensus.cc:348] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.356196 15554 raft_consensus.cc:374] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.356276 15558 raft_consensus.cc:3037] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.356542 15554 raft_consensus.cc:729] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
W20260929 11:35:48.333640 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 107305us
I20260929 11:35:48.367600 15554 consensus_queue.cc:260] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.364125 15558 raft_consensus.cc:2726] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:48.376547 15554 ts_tablet_manager.cc:1428] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.065s user 0.008s sys 0.000s
I20260929 11:35:48.377348 15554 tablet_bootstrap.cc:492] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:48.380888 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:48.367134 15364 raft_consensus.cc:2454] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:48.373134 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:48.385962 15476 leader_election.cc:302] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:48.385156 15636 raft_consensus.cc:482] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.391507 15636 raft_consensus.cc:504] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.370363 15509 raft_consensus.cc:2454] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:48.382465 15634 consensus_queue.cc:1035] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260929 11:35:48.406841 15603 consensus_queue.cc:1035] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:48.410506 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:48.410779 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:48.410522 15634 raft_consensus.cc:2781] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:48.412102 15634 raft_consensus.cc:482] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:48.412474 15634 raft_consensus.cc:3037] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.398937 15636 leader_election.cc:288] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.424873 15329 leader_election.cc:302] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.426846 15603 consensus_queue.cc:1035] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:48.428089 15640 raft_consensus.cc:2726] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:35:48.429232 15329 leader_election.cc:341] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:48.432425 15329 leader_election.cc:341] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.432876 15329 leader_election.cc:302] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.433631 15603 raft_consensus.cc:2726] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:48.438465 15554 tablet_bootstrap.cc:654] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.448770 15634 raft_consensus.cc:504] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.451637 15634 leader_election.cc:288] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:35:48.452908 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "290cd2101f81472384670fdea31eaaf6" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:48.453547 15363 raft_consensus.cc:3037] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:48.481508 15665 log.cc:924] Time spent T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
W20260929 11:35:48.483207 15329 consensus_peers.cc:487] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:48.487335 15645 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:48.506482 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "290cd2101f81472384670fdea31eaaf6" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:48.495071 15641 raft_consensus.cc:504] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.520690 15363 raft_consensus.cc:2454] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
W20260929 11:35:48.522902 15476 consensus_peers.cc:487] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:48.524094 15476 leader_election.cc:302] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
W20260929 11:35:48.532459 15478 leader_election.cc:341] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.533469 15667 raft_consensus.cc:2781] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:48.534004 15667 raft_consensus.cc:686] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:48.534322 15555 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:48.534771 15555 ts_tablet_manager.cc:1397] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.430s user 0.020s sys 0.000s
I20260929 11:35:48.538537 15555 raft_consensus.cc:348] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.539328 15555 raft_consensus.cc:374] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.540995 15555 raft_consensus.cc:729] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.534875 15667 consensus_queue.cc:237] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.541795 15555 consensus_queue.cc:260] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.551237 15555 ts_tablet_manager.cc:1428] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.016s user 0.004s sys 0.003s
I20260929 11:35:48.552165 15555 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:48.554939 15603 consensus_queue.cc:1035] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:48.567024 15259 catalog_manager.cc:5495] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:48.571935 15554 tablet_bootstrap.cc:492] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:48.575420 15554 ts_tablet_manager.cc:1397] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.198s user 0.008s sys 0.010s
I20260929 11:35:48.585856 15555 tablet_bootstrap.cc:654] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.585700 15554 raft_consensus.cc:348] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.586925 15554 raft_consensus.cc:374] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.587327 15554 raft_consensus.cc:729] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.588739 15636 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:48.591058 15259 catalog_manager.cc:5495] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:48.593415 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b927b471cd474c88c32acd488f0492" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:48.588204 15554 consensus_queue.cc:260] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.596843 15641 leader_election.cc:288] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.598228 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85b927b471cd474c88c32acd488f0492" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:48.598800 15509 raft_consensus.cc:3037] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.604059 15554 ts_tablet_manager.cc:1428] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260929 11:35:48.594000 15435 raft_consensus.cc:3037] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.605037 15554 tablet_bootstrap.cc:492] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:48.607324 15553 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:48.607759 15553 ts_tablet_manager.cc:1397] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.620s user 0.035s sys 0.015s
I20260929 11:35:48.614447 15553 raft_consensus.cc:348] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.616914 15553 raft_consensus.cc:374] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.617208 15553 raft_consensus.cc:729] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.618347 15553 consensus_queue.cc:260] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.624928 15553 ts_tablet_manager.cc:1428] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.017s user 0.004s sys 0.003s
I20260929 11:35:48.625663 15553 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:48.628481 15259 catalog_manager.cc:5495] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:48.630328 15435 raft_consensus.cc:2454] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:48.632259 15644 consensus_queue.cc:1035] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:48.635808 15329 leader_election.cc:302] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:48.636950 15645 raft_consensus.cc:2781] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:48.637392 15645 raft_consensus.cc:686] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:48.634943 15509 raft_consensus.cc:2454] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:48.638988 15645 consensus_queue.cc:237] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.666788 15554 tablet_bootstrap.cc:654] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.670094 15553 tablet_bootstrap.cc:654] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:48.672680 15329 consensus_peers.cc:487] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:48.672611 15644 raft_consensus.cc:482] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.675143 15644 raft_consensus.cc:504] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.677321 15644 leader_election.cc:288] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.679250 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9bdacdc58094518aa9198105dee0e0b" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:48.679250 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9bdacdc58094518aa9198105dee0e0b" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:48.682379 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:48.685055 15329 leader_election.cc:302] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.687561 15644 raft_consensus.cc:2726] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:48.691032 15258 catalog_manager.cc:5495] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:48.709179 15555 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:48.709684 15555 ts_tablet_manager.cc:1397] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.158s user 0.011s sys 0.007s
I20260929 11:35:48.712074 15555 raft_consensus.cc:348] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.712843 15555 raft_consensus.cc:374] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.713104 15555 raft_consensus.cc:729] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.715296 15554 tablet_bootstrap.cc:492] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:48.715857 15554 ts_tablet_manager.cc:1397] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.111s user 0.013s sys 0.004s
I20260929 11:35:48.716595 15553 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:48.717043 15553 ts_tablet_manager.cc:1397] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.092s user 0.011s sys 0.005s
I20260929 11:35:48.719427 15553 raft_consensus.cc:348] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.720991 15555 consensus_queue.cc:260] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.720155 15553 raft_consensus.cc:374] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.722154 15553 raft_consensus.cc:729] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.723493 15554 raft_consensus.cc:348] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.724262 15555 ts_tablet_manager.cc:1428] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260929 11:35:48.724457 15554 raft_consensus.cc:374] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.724994 15554 raft_consensus.cc:729] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.725255 15555 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:48.725860 15554 consensus_queue.cc:260] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.728407 15554 ts_tablet_manager.cc:1428] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260929 11:35:48.729393 15554 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:48.730919 15555 tablet_bootstrap.cc:654] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.731415 15553 consensus_queue.cc:260] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.734216 15553 ts_tablet_manager.cc:1428] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.017s user 0.003s sys 0.004s
I20260929 11:35:48.734972 15553 tablet_bootstrap.cc:492] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:48.737228 15667 raft_consensus.cc:482] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.737720 15667 raft_consensus.cc:504] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.739822 15667 leader_election.cc:288] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:48.741811 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:48.742331 15553 tablet_bootstrap.cc:654] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.745551 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
W20260929 11:35:48.745837 15478 leader_election.cc:341] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.746234 15363 raft_consensus.cc:2454] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:48.747977 15554 tablet_bootstrap.cc:654] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.749027 15476 leader_election.cc:302] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:48.750707 15667 raft_consensus.cc:2781] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:48.751112 15667 raft_consensus.cc:482] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:48.751560 15667 raft_consensus.cc:3037] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.771364 15259 catalog_manager.cc:5495] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:48.775902 15667 raft_consensus.cc:504] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.784534 15555 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:48.785079 15555 ts_tablet_manager.cc:1397] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.060s user 0.023s sys 0.009s
I20260929 11:35:48.789604 15553 tablet_bootstrap.cc:492] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:48.790081 15553 ts_tablet_manager.cc:1397] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.055s user 0.010s sys 0.003s
W20260929 11:35:48.790258 15476 consensus_peers.cc:487] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:48.793336 15554 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:48.793836 15554 ts_tablet_manager.cc:1397] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.065s user 0.012s sys 0.003s
I20260929 11:35:48.793788 15555 raft_consensus.cc:348] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.794744 15555 raft_consensus.cc:374] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.795056 15555 raft_consensus.cc:729] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.795809 15555 consensus_queue.cc:260] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.797256 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:48.797858 15363 raft_consensus.cc:3037] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.798228 15555 ts_tablet_manager.cc:1428] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260929 11:35:48.799038 15555 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:48.799441 15554 raft_consensus.cc:348] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.800143 15554 raft_consensus.cc:374] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.800436 15554 raft_consensus.cc:729] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.797070 15553 raft_consensus.cc:348] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.801052 15553 raft_consensus.cc:374] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.801342 15553 raft_consensus.cc:729] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.802057 15553 consensus_queue.cc:260] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.803329 15554 consensus_queue.cc:260] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.804500 15667 leader_election.cc:288] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:48.805801 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:48.806799 15555 tablet_bootstrap.cc:654] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.807127 15363 raft_consensus.cc:2454] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
W20260929 11:35:48.807616 15478 leader_election.cc:341] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.808408 15476 leader_election.cc:302] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:48.811646 15555 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:48.812079 15555 ts_tablet_manager.cc:1397] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260929 11:35:48.814509 15555 raft_consensus.cc:348] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.814987 15555 raft_consensus.cc:374] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.815145 15555 raft_consensus.cc:729] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.815865 15553 ts_tablet_manager.cc:1428] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.026s user 0.000s sys 0.008s
I20260929 11:35:48.817073 15553 tablet_bootstrap.cc:492] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:48.818035 15258 catalog_manager.cc:5495] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:48.821038 15626 raft_consensus.cc:2781] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:48.821563 15626 raft_consensus.cc:686] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:48.822407 15626 consensus_queue.cc:237] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.824510 15554 ts_tablet_manager.cc:1428] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.030s user 0.008s sys 0.000s
I20260929 11:35:48.815641 15555 consensus_queue.cc:260] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.829408 15554 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:48.829550 15555 ts_tablet_manager.cc:1428] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.017s user 0.001s sys 0.003s
I20260929 11:35:48.838469 15555 tablet_bootstrap.cc:492] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:48.827816 15553 tablet_bootstrap.cc:654] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.840456 15667 raft_consensus.cc:482] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.840952 15667 raft_consensus.cc:504] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.843026 15667 leader_election.cc:288] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:48.844151 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
W20260929 11:35:48.845716 15476 leader_election.cc:341] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.848380 15555 tablet_bootstrap.cc:654] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.849053 15645 raft_consensus.cc:482] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.849512 15645 raft_consensus.cc:504] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.849822 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:48.851361 15478 leader_election.cc:341] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.851547 15645 leader_election.cc:288] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.851807 15478 leader_election.cc:302] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:48.853796 15554 tablet_bootstrap.cc:654] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.853863 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:48.855753 15329 leader_election.cc:341] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.857002 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:48.858302 15329 leader_election.cc:341] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.858700 15329 leader_election.cc:302] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.858935 15667 raft_consensus.cc:2726] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:48.859957 15645 raft_consensus.cc:2726] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:48.865070 15553 tablet_bootstrap.cc:492] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:48.865531 15553 ts_tablet_manager.cc:1397] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.049s user 0.024s sys 0.002s
I20260929 11:35:48.866472 15555 tablet_bootstrap.cc:492] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:48.866870 15555 ts_tablet_manager.cc:1397] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.012s
I20260929 11:35:48.867908 15553 raft_consensus.cc:348] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.868590 15553 raft_consensus.cc:374] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.868896 15553 raft_consensus.cc:729] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.870041 15555 raft_consensus.cc:348] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.870693 15555 raft_consensus.cc:374] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.869978 15553 consensus_queue.cc:260] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.870925 15555 raft_consensus.cc:729] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.874827 15555 consensus_queue.cc:260] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.875603 15258 catalog_manager.cc:5495] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:48.877206 15555 ts_tablet_manager.cc:1428] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260929 11:35:48.878091 15555 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:48.872355 15553 ts_tablet_manager.cc:1428] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260929 11:35:48.881577 15553 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:48.886863 15555 tablet_bootstrap.cc:654] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.894960 15553 tablet_bootstrap.cc:654] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.902350 15555 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:48.902886 15555 ts_tablet_manager.cc:1397] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.009s
I20260929 11:35:48.903174 15554 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:48.903635 15554 ts_tablet_manager.cc:1397] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.074s user 0.012s sys 0.004s
I20260929 11:35:48.905397 15555 raft_consensus.cc:348] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.906200 15555 raft_consensus.cc:374] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.906046 15554 raft_consensus.cc:348] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.906529 15555 raft_consensus.cc:729] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.906769 15554 raft_consensus.cc:374] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.907490 15554 raft_consensus.cc:729] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.907176 15555 consensus_queue.cc:260] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.912370 15555 ts_tablet_manager.cc:1428] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260929 11:35:48.913344 15555 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:48.914215 15553 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:48.914644 15553 ts_tablet_manager.cc:1397] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.005s
I20260929 11:35:48.917057 15553 raft_consensus.cc:348] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.917755 15553 raft_consensus.cc:374] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.918008 15553 raft_consensus.cc:729] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.919044 15555 tablet_bootstrap.cc:654] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.918614 15553 consensus_queue.cc:260] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.908063 15554 consensus_queue.cc:260] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.926450 15554 ts_tablet_manager.cc:1428] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.022s user 0.000s sys 0.005s
I20260929 11:35:48.927397 15554 tablet_bootstrap.cc:492] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:48.929495 15553 ts_tablet_manager.cc:1428] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260929 11:35:48.930477 15553 tablet_bootstrap.cc:492] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:48.934715 15622 raft_consensus.cc:482] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.935227 15622 raft_consensus.cc:504] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.936196 15553 tablet_bootstrap.cc:654] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.937729 15622 leader_election.cc:288] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.941869 15554 tablet_bootstrap.cc:654] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:48.941942 15626 raft_consensus.cc:482] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.939863 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:48.940670 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:48.945209 15555 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:48.945729 15555 ts_tablet_manager.cc:1397] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.015s
I20260929 11:35:48.946033 15404 leader_election.cc:302] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.942425 15626 raft_consensus.cc:504] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.948365 15622 raft_consensus.cc:2726] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:48.951148 15510 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.951907 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4452619bf4405caf985d1675be1408" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:48.951725 15555 raft_consensus.cc:348] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.952457 15555 raft_consensus.cc:374] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:48.952541 15363 raft_consensus.cc:2454] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:48.952747 15555 raft_consensus.cc:729] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:48.953388 15555 consensus_queue.cc:260] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.953840 15476 leader_election.cc:302] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:48.954756 15635 raft_consensus.cc:2781] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:48.955214 15635 raft_consensus.cc:482] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:48.955474 15626 leader_election.cc:288] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:48.959906 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4452619bf4405caf985d1675be1408" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:48.963143 15478 leader_election.cc:341] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:48.955607 15635 raft_consensus.cc:3037] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:48.955497 15555 ts_tablet_manager.cc:1428] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260929 11:35:48.967537 15555 tablet_bootstrap.cc:492] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:48.968586 15626 consensus_queue.cc:1035] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:48.971583 15621 raft_consensus.cc:482] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:48.972239 15621 raft_consensus.cc:504] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:48.976399 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "290cd2101f81472384670fdea31eaaf6" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:48.977452 15363 raft_consensus.cc:2379] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:48.992039 15621 leader_election.cc:288] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:48.994894 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "290cd2101f81472384670fdea31eaaf6" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:48.997165 15404 leader_election.cc:302] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:48.998762 15621 raft_consensus.cc:3037] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.002041 15645 raft_consensus.cc:482] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.002545 15645 raft_consensus.cc:504] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.004653 15555 tablet_bootstrap.cc:654] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.005440 15603 raft_consensus.cc:482] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.005919 15603 raft_consensus.cc:504] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.007853 15603 leader_election.cc:288] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.009042 15645 leader_election.cc:288] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.009398 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.011801 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20bfb5db2aab4679856838ec11feffc9" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:49.012734 15435 raft_consensus.cc:2454] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:49.014227 15329 leader_election.cc:302] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:49.015623 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:49.016485 15439 raft_consensus.cc:2454] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:49.018237 15329 leader_election.cc:302] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:49.019227 15603 raft_consensus.cc:2781] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:49.019517 15645 raft_consensus.cc:2781] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:49.019584 15603 raft_consensus.cc:482] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:49.020038 15603 raft_consensus.cc:3037] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.019977 15645 raft_consensus.cc:482] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:49.042917 15635 raft_consensus.cc:504] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.050658 15641 raft_consensus.cc:482] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.029752 15645 raft_consensus.cc:3037] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.029488 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20bfb5db2aab4679856838ec11feffc9" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.056851 15555 tablet_bootstrap.cc:492] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:49.057387 15555 ts_tablet_manager.cc:1397] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.090s user 0.011s sys 0.018s
W20260929 11:35:49.048511 15329 leader_election.cc:341] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.062671 15553 tablet_bootstrap.cc:492] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:49.063278 15553 ts_tablet_manager.cc:1397] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.133s user 0.055s sys 0.049s
I20260929 11:35:49.064821 15635 leader_election.cc:288] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:49.065457 15621 raft_consensus.cc:2726] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:49.066253 15554 tablet_bootstrap.cc:492] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:49.066696 15554 ts_tablet_manager.cc:1397] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.139s user 0.044s sys 0.045s
I20260929 11:35:49.054760 15641 raft_consensus.cc:504] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.072186 15641 leader_election.cc:288] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.072913 15553 raft_consensus.cc:348] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.073661 15553 raft_consensus.cc:374] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.073483 15555 raft_consensus.cc:348] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.105749 15553 raft_consensus.cc:729] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.106171 15555 raft_consensus.cc:374] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.106710 15553 consensus_queue.cc:260] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.106499 15555 raft_consensus.cc:729] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.108124 15555 consensus_queue.cc:260] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.108451 15554 raft_consensus.cc:348] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.109033 15554 raft_consensus.cc:374] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.109238 15554 raft_consensus.cc:729] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.109728 15554 consensus_queue.cc:260] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.093106 15645 raft_consensus.cc:504] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.113025 15555 ts_tablet_manager.cc:1428] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.055s user 0.009s sys 0.000s
I20260929 11:35:49.114116 15553 ts_tablet_manager.cc:1428] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.050s user 0.008s sys 0.030s
I20260929 11:35:49.115468 15555 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:49.115520 15553 tablet_bootstrap.cc:492] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:49.085647 15603 raft_consensus.cc:504] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.118083 15603 leader_election.cc:288] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.101266 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:49.126572 15329 leader_election.cc:341] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.129868 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:49.130503 15438 raft_consensus.cc:3037] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:49.107365 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 53788us
I20260929 11:35:49.137326 15554 ts_tablet_manager.cc:1428] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.070s user 0.005s sys 0.000s
I20260929 11:35:49.137696 15645 leader_election.cc:288] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.139593 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20bfb5db2aab4679856838ec11feffc9" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:49.140245 15439 raft_consensus.cc:3037] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.151623 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.153530 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4452619bf4405caf985d1675be1408" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:49.154141 15363 raft_consensus.cc:3037] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.154378 15667 raft_consensus.cc:482] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79f6b689389549ce8079ff46fd514467)
I20260929 11:35:49.154875 15667 raft_consensus.cc:504] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.156826 15361 raft_consensus.cc:3037] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.156589 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20bfb5db2aab4679856838ec11feffc9" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:49.160897 15555 tablet_bootstrap.cc:654] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.167027 15438 raft_consensus.cc:2454] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:49.167316 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4452619bf4405caf985d1675be1408" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:49.168365 15554 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:49.173521 15667 leader_election.cc:288] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:49.176785 15439 raft_consensus.cc:2454] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:49.173660 15363 raft_consensus.cc:2454] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:49.180794 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
W20260929 11:35:49.183538 15478 leader_election.cc:341] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:49.189057 15329 leader_election.cc:341] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.190166 15329 leader_election.cc:302] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:49.190380 15667 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:49.194329 15476 leader_election.cc:302] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:49.194453 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:49.195148 15706 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:49.199812 15706 raft_consensus.cc:2781] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:49.200345 15706 raft_consensus.cc:686] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:49.201140 15706 consensus_queue.cc:237] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:49.202087 15329 leader_election.cc:341] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.209177 15553 tablet_bootstrap.cc:654] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.205832 15641 raft_consensus.cc:2781] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:49.205962 15329 leader_election.cc:302] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:49.210075 15641 raft_consensus.cc:686] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
W20260929 11:35:49.210814 15329 leader_election.cc:341] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.210893 15641 consensus_queue.cc:237] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:49.211540 15329 leader_election.cc:341] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.208531 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:49.214562 15603 raft_consensus.cc:2726] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:49.207574 15636 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260929 11:35:49.231187 15555 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:49.231628 15555 ts_tablet_manager.cc:1397] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.116s user 0.026s sys 0.012s
I20260929 11:35:49.226197 15621 raft_consensus.cc:482] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.234407 15478 leader_election.cc:302] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:49.236495 15704 raft_consensus.cc:2726] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:35:49.233830 15621 raft_consensus.cc:504] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.238469 15621 leader_election.cc:288] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.241693 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.242597 15512 raft_consensus.cc:2454] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:49.243381 15329 leader_election.cc:302] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:49.243871 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:49.245208 15364 raft_consensus.cc:2454] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:49.243880 15404 leader_election.cc:302] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:49.251335 15622 raft_consensus.cc:2781] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:49.251816 15622 raft_consensus.cc:482] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:49.252266 15622 raft_consensus.cc:3037] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.240161 15621 raft_consensus.cc:482] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.254063 15621 raft_consensus.cc:504] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.257251 15621 leader_election.cc:288] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.249699 15603 raft_consensus.cc:2781] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:49.258430 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:49.259588 15364 raft_consensus.cc:2379] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:49.265650 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.258490 15603 raft_consensus.cc:686] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:49.288512 15402 leader_election.cc:302] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:49.294591 15555 raft_consensus.cc:348] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.295400 15555 raft_consensus.cc:374] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.295673 15555 raft_consensus.cc:729] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.291656 15435 raft_consensus.cc:3037] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.297758 15622 raft_consensus.cc:504] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.301453 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:49.296276 15555 consensus_queue.cc:260] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.302225 15362 raft_consensus.cc:3037] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.325838 15554 tablet_bootstrap.cc:654] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.327414 15603 consensus_queue.cc:237] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.330642 15641 raft_consensus.cc:482] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.331308 15641 raft_consensus.cc:504] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.333891 15641 leader_election.cc:288] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.335035 15622 leader_election.cc:288] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.348647 15641 raft_consensus.cc:482] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.349258 15641 raft_consensus.cc:504] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.336486 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:49.353552 15258 catalog_manager.cc:5495] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:49.355901 15510 raft_consensus.cc:3037] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.357647 15362 raft_consensus.cc:2454] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:49.358788 15402 leader_election.cc:302] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:49.359586 15622 raft_consensus.cc:2781] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:49.360343 15622 raft_consensus.cc:686] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:49.360220 15706 consensus_queue.cc:1035] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:49.361161 15622 consensus_queue.cc:237] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.359583 15558 raft_consensus.cc:2726] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:49.371037 15555 ts_tablet_manager.cc:1428] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.139s user 0.009s sys 0.006s
I20260929 11:35:49.371810 15555 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:49.377494 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96455e9e76c407ab71b312b680a9c93" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.394860 15510 raft_consensus.cc:2454] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:49.399590 15439 raft_consensus.cc:3037] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.413085 15706 consensus_queue.cc:1035] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:49.455628 15558 raft_consensus.cc:482] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:35:49.455950 15329 leader_election.cc:341] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.462189 15558 raft_consensus.cc:504] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.464923 15558 leader_election.cc:288] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.565327 15554 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:49.565400 15641 leader_election.cc:288] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.567768 15555 tablet_bootstrap.cc:654] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.571560 15553 tablet_bootstrap.cc:492] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:49.573740 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96455e9e76c407ab71b312b680a9c93" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.570704 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96455e9e76c407ab71b312b680a9c93" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:49.575428 15553 ts_tablet_manager.cc:1397] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.460s user 0.019s sys 0.049s
I20260929 11:35:49.577191 15554 ts_tablet_manager.cc:1397] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.409s user 0.017s sys 0.033s
I20260929 11:35:49.573820 15721 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:49.581178 15434 raft_consensus.cc:2454] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:49.593343 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96455e9e76c407ab71b312b680a9c93" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:49.594172 15362 raft_consensus.cc:2454] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:49.597301 15553 raft_consensus.cc:348] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.598160 15553 raft_consensus.cc:374] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.598562 15553 raft_consensus.cc:729] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.599222 15553 consensus_queue.cc:260] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:49.591022 15404 leader_election.cc:341] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.598979 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809d1abd25d74defa0a2869d15a553b7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:49.609218 15553 ts_tablet_manager.cc:1428] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.032s user 0.005s sys 0.000s
I20260929 11:35:49.610214 15553 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:49.613019 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809d1abd25d74defa0a2869d15a553b7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.617250 15512 raft_consensus.cc:2454] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:49.629487 15259 catalog_manager.cc:5495] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:49.637090 15554 raft_consensus.cc:348] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.639110 15554 raft_consensus.cc:374] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.640014 15554 raft_consensus.cc:729] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.640667 15554 consensus_queue.cc:260] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.647704 15554 ts_tablet_manager.cc:1428] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.070s user 0.006s sys 0.000s
I20260929 11:35:49.651594 15402 leader_election.cc:302] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:49.653059 15622 raft_consensus.cc:2781] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:49.653468 15622 raft_consensus.cc:482] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:49.653792 15622 raft_consensus.cc:3037] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.660182 15554 tablet_bootstrap.cc:492] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:49.666379 15622 raft_consensus.cc:504] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.669417 15554 tablet_bootstrap.cc:654] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.670883 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96455e9e76c407ab71b312b680a9c93" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:49.671869 15362 raft_consensus.cc:3037] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.672521 15260 catalog_manager.cc:5495] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:49.674233 15260 catalog_manager.cc:5495] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:49.675400 15329 leader_election.cc:302] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:49.676726 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96455e9e76c407ab71b312b680a9c93" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
W20260929 11:35:49.678098 15404 leader_election.cc:341] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:49.679646 15329 leader_election.cc:341] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.680996 15555 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:49.681429 15555 ts_tablet_manager.cc:1397] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.310s user 0.012s sys 0.002s
I20260929 11:35:49.683388 15553 tablet_bootstrap.cc:654] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.682148 15362 raft_consensus.cc:2454] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:49.697513 15721 raft_consensus.cc:2741] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260929 11:35:49.688200 15329 leader_election.cc:302] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:49.693069 15554 tablet_bootstrap.cc:492] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:49.699406 15554 ts_tablet_manager.cc:1397] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.039s user 0.012s sys 0.002s
I20260929 11:35:49.684008 15555 raft_consensus.cc:348] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.700827 15555 raft_consensus.cc:374] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.700737 15402 leader_election.cc:302] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:49.701164 15555 raft_consensus.cc:729] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.701670 15558 raft_consensus.cc:2781] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:49.702128 15558 raft_consensus.cc:686] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:49.701901 15555 consensus_queue.cc:260] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.702888 15558 consensus_queue.cc:237] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.704356 15555 ts_tablet_manager.cc:1428] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260929 11:35:49.706146 15555 tablet_bootstrap.cc:492] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:49.699450 15721 raft_consensus.cc:2781] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:49.707757 15721 raft_consensus.cc:482] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:49.708103 15721 raft_consensus.cc:3037] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.681955 15622 leader_election.cc:288] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
W20260929 11:35:49.711906 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:49.717542 15554 raft_consensus.cc:348] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.718354 15553 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:49.718441 15554 raft_consensus.cc:374] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.718880 15553 ts_tablet_manager.cc:1397] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.109s user 0.007s sys 0.003s
I20260929 11:35:49.720089 15554 raft_consensus.cc:729] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.722380 15555 tablet_bootstrap.cc:654] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.724031 15554 consensus_queue.cc:260] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.726341 15554 ts_tablet_manager.cc:1428] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20260929 11:35:49.729378 15553 raft_consensus.cc:348] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.729938 15554 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:49.730098 15553 raft_consensus.cc:374] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.730444 15553 raft_consensus.cc:729] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.731029 15553 consensus_queue.cc:260] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.734004 15553 ts_tablet_manager.cc:1428] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.015s user 0.001s sys 0.005s
I20260929 11:35:49.734932 15553 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:49.724115 15721 raft_consensus.cc:504] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.737118 15555 tablet_bootstrap.cc:492] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:49.737593 15555 ts_tablet_manager.cc:1397] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.000s
I20260929 11:35:49.738391 15554 tablet_bootstrap.cc:654] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.740880 15555 raft_consensus.cc:348] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.741662 15555 raft_consensus.cc:374] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.741772 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809d1abd25d74defa0a2869d15a553b7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:49.741988 15555 raft_consensus.cc:729] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
W20260929 11:35:49.742952 15329 leader_election.cc:341] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.745452 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809d1abd25d74defa0a2869d15a553b7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:49.746065 15512 raft_consensus.cc:3037] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.747352 15553 tablet_bootstrap.cc:654] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.752439 15555 consensus_queue.cc:260] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.754575 15555 ts_tablet_manager.cc:1428] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
I20260929 11:35:49.755421 15555 tablet_bootstrap.cc:492] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:49.761634 15721 leader_election.cc:288] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.763018 15512 raft_consensus.cc:2454] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:49.764199 15329 leader_election.cc:302] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:49.764883 15555 tablet_bootstrap.cc:654] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.766510 15262 catalog_manager.cc:5495] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:49.771536 15553 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:49.772010 15553 ts_tablet_manager.cc:1397] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.037s user 0.013s sys 0.003s
I20260929 11:35:49.776966 15361 raft_consensus.cc:3037] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.779431 15553 raft_consensus.cc:348] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.780182 15553 raft_consensus.cc:374] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.780481 15553 raft_consensus.cc:729] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.782775 15554 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:49.783227 15554 ts_tablet_manager.cc:1397] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.053s user 0.007s sys 0.029s
I20260929 11:35:49.785696 15554 raft_consensus.cc:348] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.786438 15554 raft_consensus.cc:374] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.786713 15554 raft_consensus.cc:729] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.787329 15554 consensus_queue.cc:260] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.790591 15554 ts_tablet_manager.cc:1428] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260929 11:35:49.790740 15721 raft_consensus.cc:2781] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:49.791390 15721 raft_consensus.cc:686] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:49.791206 15553 consensus_queue.cc:260] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.792661 15721 consensus_queue.cc:237] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.793349 15553 ts_tablet_manager.cc:1428] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260929 11:35:49.793707 15717 raft_consensus.cc:482] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.794229 15554 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:49.794168 15717 raft_consensus.cc:504] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.796072 15717 leader_election.cc:288] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.799010 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:49.800196 15329 leader_election.cc:341] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.800638 15554 tablet_bootstrap.cc:654] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.803360 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:49.803838 15553 tablet_bootstrap.cc:492] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
W20260929 11:35:49.804719 15329 leader_election.cc:341] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:49.805112 15329 leader_election.cc:302] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:49.806051 15717 raft_consensus.cc:2726] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:35:49.807761 15478 consensus_peers.cc:487] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:49.810148 15717 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:49.813166 15553 tablet_bootstrap.cc:654] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.830834 15554 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:49.833247 15554 ts_tablet_manager.cc:1397] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.039s user 0.013s sys 0.002s
I20260929 11:35:49.835767 15706 consensus_queue.cc:1035] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:49.840191 15554 raft_consensus.cc:348] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.843205 15554 raft_consensus.cc:374] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.843545 15554 raft_consensus.cc:729] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.845607 15554 consensus_queue.cc:260] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.849920 15554 ts_tablet_manager.cc:1428] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.016s user 0.006s sys 0.002s
I20260929 11:35:49.852207 15554 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:49.854758 15555 tablet_bootstrap.cc:492] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:49.850785 15622 raft_consensus.cc:482] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.858246 15622 raft_consensus.cc:504] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.854367 15635 raft_consensus.cc:482] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.860747 15635 raft_consensus.cc:504] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.861912 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.862742 15635 leader_election.cc:288] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:49.862828 15512 raft_consensus.cc:2454] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:49.863499 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:49.864085 15364 raft_consensus.cc:2454] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:49.864711 15404 leader_election.cc:302] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:49.865813 15558 raft_consensus.cc:2781] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:49.866123 15558 raft_consensus.cc:482] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:49.866420 15558 raft_consensus.cc:3037] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.871974 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20bfb5db2aab4679856838ec11feffc9" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:49.872365 15555 ts_tablet_manager.cc:1397] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.117s user 0.021s sys 0.038s
I20260929 11:35:49.872606 15622 leader_election.cc:288] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.872826 15434 raft_consensus.cc:2379] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:49.872141 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20bfb5db2aab4679856838ec11feffc9" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:49.879592 15717 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:49.886829 15555 raft_consensus.cc:348] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.887583 15555 raft_consensus.cc:374] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.887837 15555 raft_consensus.cc:729] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.888302 15555 consensus_queue.cc:260] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.883378 15512 raft_consensus.cc:3037] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.890813 15476 leader_election.cc:302] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:49.899587 15553 tablet_bootstrap.cc:492] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:49.900038 15553 ts_tablet_manager.cc:1397] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.096s user 0.017s sys 0.004s
I20260929 11:35:49.946115 15621 raft_consensus.cc:482] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.955866 15621 raft_consensus.cc:504] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.958061 15553 raft_consensus.cc:348] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.937562 15706 raft_consensus.cc:482] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.959461 15706 raft_consensus.cc:504] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.902720 15555 ts_tablet_manager.cc:1428] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.030s user 0.003s sys 0.003s
I20260929 11:35:49.963016 15555 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:49.963413 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:49.964286 15434 raft_consensus.cc:2454] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:49.966089 15478 leader_election.cc:302] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:49.953125 15554 tablet_bootstrap.cc:654] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:49.969734 15622 consensus_queue.cc:1035] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:49.943399 15705 raft_consensus.cc:482] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.972244 15705 raft_consensus.cc:504] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.974941 15705 leader_election.cc:288] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:49.975636 15705 raft_consensus.cc:2781] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:49.977097 15706 leader_election.cc:288] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:49.978369 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:49.981374 15509 raft_consensus.cc:2454] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:49.983253 15404 leader_election.cc:302] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:49.958969 15553 raft_consensus.cc:374] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:49.984481 15553 raft_consensus.cc:729] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:49.985646 15622 raft_consensus.cc:2781] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:49.985487 15553 consensus_queue.cc:260] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.986194 15622 raft_consensus.cc:482] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:49.986668 15622 raft_consensus.cc:3037] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:49.990170 15558 raft_consensus.cc:504] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.991506 15706 raft_consensus.cc:482] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:49.992281 15706 raft_consensus.cc:504] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:49.976044 15705 raft_consensus.cc:482] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:49.979444 15621 leader_election.cc:288] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:49.899926 15635 raft_consensus.cc:3037] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.009433 15621 consensus_queue.cc:1035] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260929 11:35:50.004055 15705 raft_consensus.cc:3037] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.020910 15553 ts_tablet_manager.cc:1428] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.066s user 0.008s sys 0.003s
I20260929 11:35:50.022832 15553 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:50.016356 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:50.023507 15361 raft_consensus.cc:2454] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:50.026844 15558 leader_election.cc:288] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.033231 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:50.033958 15364 raft_consensus.cc:3037] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.036484 15555 tablet_bootstrap.cc:654] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.017745 15706 leader_election.cc:288] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
W20260929 11:35:50.015412 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 49451us
I20260929 11:35:50.063593 15622 raft_consensus.cc:504] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.065590 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.067390 15553 tablet_bootstrap.cc:654] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.068506 15364 raft_consensus.cc:2454] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
W20260929 11:35:50.029017 15404 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 44547.7us
I20260929 11:35:50.073153 15715 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:50.074028 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:50.074653 15509 raft_consensus.cc:3037] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.080404 15554 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:50.080900 15554 ts_tablet_manager.cc:1397] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.229s user 0.023s sys 0.014s
I20260929 11:35:50.082438 15402 leader_election.cc:302] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:50.083601 15745 raft_consensus.cc:2781] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:50.084093 15745 raft_consensus.cc:686] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:50.084908 15745 consensus_queue.cc:237] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.086474 15622 leader_election.cc:288] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.086793 15554 raft_consensus.cc:348] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.087467 15554 raft_consensus.cc:374] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.089162 15554 raft_consensus.cc:729] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.089826 15554 consensus_queue.cc:260] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.092074 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:50.091543 15258 catalog_manager.cc:5495] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:50.096942 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:50.097353 15554 ts_tablet_manager.cc:1428] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.016s user 0.004s sys 0.004s
I20260929 11:35:50.098654 15554 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:50.094426 15513 raft_consensus.cc:3037] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.084905 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.110123 15635 raft_consensus.cc:2726] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:50.113953 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:50.122668 15439 raft_consensus.cc:2379] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 2b2ed85c4da64515a0664b6c0421e078 in this term.
I20260929 11:35:50.121676 15362 raft_consensus.cc:2454] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:50.128350 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:50.128914 15717 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:50.138015 15555 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:50.138587 15555 ts_tablet_manager.cc:1397] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.176s user 0.015s sys 0.005s
I20260929 11:35:50.137475 15705 raft_consensus.cc:504] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:50.154419 15476 leader_election.cc:341] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.155915 15705 leader_election.cc:288] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:50.156679 15476 leader_election.cc:302] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:50.159114 15476 leader_election.cc:302] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:50.160954 15749 raft_consensus.cc:2726] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:35:50.160902 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:50.161602 15364 raft_consensus.cc:3037] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:50.162461 15329 consensus_peers.cc:487] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260929 11:35:50.163539 15513 raft_consensus.cc:2454] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:50.164302 15744 raft_consensus.cc:2741] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260929 11:35:50.169386 15404 leader_election.cc:302] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:50.170282 15745 raft_consensus.cc:2781] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:50.170724 15745 raft_consensus.cc:686] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:50.139209 15509 raft_consensus.cc:2454] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:50.171512 15745 consensus_queue.cc:237] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.173177 15258 catalog_manager.cc:5495] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:50.175217 15554 tablet_bootstrap.cc:654] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.179637 15558 raft_consensus.cc:482] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:35:50.181726 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 86473.9us
I20260929 11:35:50.183210 15621 consensus_queue.cc:1035] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:50.183674 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:50.188158 15558 raft_consensus.cc:504] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.190196 15558 leader_election.cc:288] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.190841 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:50.191437 15439 raft_consensus.cc:3037] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:50.196743 15476 leader_election.cc:341] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.202579 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809d1abd25d74defa0a2869d15a553b7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
W20260929 11:35:50.204365 15404 consensus_peers.cc:487] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:50.211792 15439 raft_consensus.cc:2454] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:50.198686 15555 raft_consensus.cc:348] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.220266 15364 raft_consensus.cc:2454] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:50.221330 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "809d1abd25d74defa0a2869d15a553b7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:50.223304 15508 raft_consensus.cc:2379] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:50.220791 15555 raft_consensus.cc:374] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.224210 15555 raft_consensus.cc:729] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.225320 15404 leader_election.cc:302] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:50.226904 15746 raft_consensus.cc:3037] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.226818 15478 leader_election.cc:302] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters: 79f6b689389549ce8079ff46fd514467
I20260929 11:35:50.229981 15744 raft_consensus.cc:2781] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:50.230453 15744 raft_consensus.cc:686] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:50.231561 15744 consensus_queue.cc:237] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.234730 15555 consensus_queue.cc:260] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.239066 15555 ts_tablet_manager.cc:1428] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.100s user 0.005s sys 0.003s
I20260929 11:35:50.240196 15555 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:50.246941 15746 raft_consensus.cc:2726] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:50.255262 15555 tablet_bootstrap.cc:654] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.263033 15262 catalog_manager.cc:5495] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:50.285384 15509 raft_consensus.cc:3037] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.302340 15553 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:50.302860 15553 ts_tablet_manager.cc:1397] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.280s user 0.016s sys 0.029s
I20260929 11:35:50.303108 15555 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:50.303558 15555 ts_tablet_manager.cc:1397] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.064s user 0.021s sys 0.022s
I20260929 11:35:50.305354 15553 raft_consensus.cc:348] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.306108 15553 raft_consensus.cc:374] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.307041 15555 raft_consensus.cc:348] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.307850 15555 raft_consensus.cc:374] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.308140 15555 raft_consensus.cc:729] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.308187 15554 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:50.308853 15554 ts_tablet_manager.cc:1397] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.210s user 0.014s sys 0.003s
I20260929 11:35:50.308943 15555 consensus_queue.cc:260] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.310182 15553 raft_consensus.cc:729] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.311097 15553 consensus_queue.cc:260] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.311849 15555 ts_tablet_manager.cc:1428] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260929 11:35:50.312579 15554 raft_consensus.cc:348] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.317026 15554 raft_consensus.cc:374] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.317557 15554 raft_consensus.cc:729] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.317586 15555 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:50.318287 15554 consensus_queue.cc:260] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.325358 15554 ts_tablet_manager.cc:1428] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260929 11:35:50.325798 15555 tablet_bootstrap.cc:654] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.326228 15554 tablet_bootstrap.cc:492] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:50.326333 15721 raft_consensus.cc:482] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.326850 15721 raft_consensus.cc:504] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.332378 15553 ts_tablet_manager.cc:1428] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.029s user 0.007s sys 0.001s
I20260929 11:35:50.332886 15721 leader_election.cc:288] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.333348 15553 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:50.334892 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:50.336113 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:50.336458 15329 leader_election.cc:341] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:50.337435 15329 leader_election.cc:341] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.337808 15329 leader_election.cc:302] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:50.338935 15721 raft_consensus.cc:2726] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:50.346940 15259 catalog_manager.cc:5495] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:50.360545 15554 tablet_bootstrap.cc:654] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.361729 15553 tablet_bootstrap.cc:654] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.362471 15555 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:50.363355 15555 ts_tablet_manager.cc:1397] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.046s user 0.034s sys 0.001s
I20260929 11:35:50.366174 15555 raft_consensus.cc:348] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.367102 15555 raft_consensus.cc:374] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.367440 15555 raft_consensus.cc:729] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.368399 15555 consensus_queue.cc:260] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.371593 15555 ts_tablet_manager.cc:1428] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260929 11:35:50.373098 15555 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:50.374823 15553 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:50.375249 15553 ts_tablet_manager.cc:1397] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.042s user 0.012s sys 0.005s
I20260929 11:35:50.375988 15721 consensus_queue.cc:1035] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:50.377712 15553 raft_consensus.cc:348] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.378412 15553 raft_consensus.cc:374] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.378652 15553 raft_consensus.cc:729] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.379027 15555 tablet_bootstrap.cc:654] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.379660 15553 consensus_queue.cc:260] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.381629 15553 ts_tablet_manager.cc:1428] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260929 11:35:50.382443 15553 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:50.385700 15554 tablet_bootstrap.cc:492] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:50.386147 15554 ts_tablet_manager.cc:1397] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.060s user 0.007s sys 0.009s
I20260929 11:35:50.388453 15554 raft_consensus.cc:348] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.389127 15554 raft_consensus.cc:374] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.389377 15554 raft_consensus.cc:729] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.389935 15554 consensus_queue.cc:260] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.391815 15554 ts_tablet_manager.cc:1428] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260929 11:35:50.392954 15554 tablet_bootstrap.cc:492] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:50.398155 15554 tablet_bootstrap.cc:654] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.404569 15553 tablet_bootstrap.cc:654] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.411890 15553 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:50.412312 15553 ts_tablet_manager.cc:1397] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.004s
I20260929 11:35:50.415493 15553 raft_consensus.cc:348] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.416452 15553 raft_consensus.cc:374] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.416760 15553 raft_consensus.cc:729] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.426800 15555 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:50.427289 15555 ts_tablet_manager.cc:1397] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.054s user 0.019s sys 0.027s
I20260929 11:35:50.427439 15715 consensus_queue.cc:1035] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:50.429664 15555 raft_consensus.cc:348] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.430351 15555 raft_consensus.cc:374] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.430610 15555 raft_consensus.cc:729] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.417729 15553 consensus_queue.cc:260] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.431414 15555 consensus_queue.cc:260] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.433614 15555 ts_tablet_manager.cc:1428] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260929 11:35:50.434036 15745 raft_consensus.cc:482] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.434952 15745 raft_consensus.cc:504] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.435809 15555 tablet_bootstrap.cc:492] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:50.437326 15745 leader_election.cc:288] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.438987 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4452619bf4405caf985d1675be1408" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:50.439214 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4452619bf4405caf985d1675be1408" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:50.440698 15553 ts_tablet_manager.cc:1428] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.028s user 0.008s sys 0.000s
I20260929 11:35:50.440858 15404 leader_election.cc:302] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:50.442502 15745 raft_consensus.cc:2726] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:50.444100 15553 tablet_bootstrap.cc:492] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:50.446022 15555 tablet_bootstrap.cc:654] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.468554 15553 tablet_bootstrap.cc:654] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.480909 15555 tablet_bootstrap.cc:492] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:50.481393 15555 ts_tablet_manager.cc:1397] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.025s
I20260929 11:35:50.494005 15555 raft_consensus.cc:348] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.494771 15555 raft_consensus.cc:374] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.495059 15555 raft_consensus.cc:729] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.495694 15555 consensus_queue.cc:260] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.497386 15555 ts_tablet_manager.cc:1428] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260929 11:35:50.498298 15553 tablet_bootstrap.cc:492] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:50.498502 15554 tablet_bootstrap.cc:492] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:50.498684 15555 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:50.498739 15553 ts_tablet_manager.cc:1397] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.055s user 0.014s sys 0.009s
I20260929 11:35:50.498955 15554 ts_tablet_manager.cc:1397] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.106s user 0.025s sys 0.042s
I20260929 11:35:50.501511 15554 raft_consensus.cc:348] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.502203 15554 raft_consensus.cc:374] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.502453 15554 raft_consensus.cc:729] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.503021 15554 consensus_queue.cc:260] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.504751 15555 tablet_bootstrap.cc:654] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.505129 15554 ts_tablet_manager.cc:1428] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260929 11:35:50.506016 15554 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:50.511545 15554 tablet_bootstrap.cc:654] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.513849 15553 raft_consensus.cc:348] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.514627 15553 raft_consensus.cc:374] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.514959 15553 raft_consensus.cc:729] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.515636 15553 consensus_queue.cc:260] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.517899 15553 ts_tablet_manager.cc:1428] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20260929 11:35:50.518810 15553 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:50.524204 15553 tablet_bootstrap.cc:654] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.539559 15554 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:50.540413 15554 ts_tablet_manager.cc:1397] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.011s
I20260929 11:35:50.543881 15554 raft_consensus.cc:348] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.546281 15554 raft_consensus.cc:374] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.546608 15554 raft_consensus.cc:729] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.547492 15555 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:50.547310 15554 consensus_queue.cc:260] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.547926 15555 ts_tablet_manager.cc:1397] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.049s user 0.020s sys 0.024s
I20260929 11:35:50.549654 15554 ts_tablet_manager.cc:1428] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260929 11:35:50.553414 15555 raft_consensus.cc:348] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.553902 15554 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:50.554168 15555 raft_consensus.cc:374] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.554440 15555 raft_consensus.cc:729] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.555016 15555 consensus_queue.cc:260] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.557518 15555 ts_tablet_manager.cc:1428] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260929 11:35:50.558501 15555 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:50.560761 15554 tablet_bootstrap.cc:654] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.564946 15553 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:50.565414 15553 ts_tablet_manager.cc:1397] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.047s user 0.015s sys 0.022s
I20260929 11:35:50.567399 15555 tablet_bootstrap.cc:654] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.569644 15553 raft_consensus.cc:348] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.570483 15553 raft_consensus.cc:374] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.570804 15553 raft_consensus.cc:729] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.571586 15553 consensus_queue.cc:260] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.575095 15553 ts_tablet_manager.cc:1428] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260929 11:35:50.575191 15554 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:50.576025 15554 ts_tablet_manager.cc:1397] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.002s
I20260929 11:35:50.576953 15553 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:50.587482 15721 raft_consensus.cc:482] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.587978 15721 raft_consensus.cc:504] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.589856 15745 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:50.591115 15721 leader_election.cc:288] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.594771 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f3d509852942e2b45c13e1f5c5ea8d" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:50.594853 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f3d509852942e2b45c13e1f5c5ea8d" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.585525 15554 raft_consensus.cc:348] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.596470 15554 raft_consensus.cc:374] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.596903 15554 raft_consensus.cc:729] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
W20260929 11:35:50.601883 15329 leader_election.cc:341] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.602281 15554 consensus_queue.cc:260] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:50.603647 15329 leader_election.cc:341] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.604225 15329 leader_election.cc:302] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:50.605435 15603 raft_consensus.cc:2726] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:50.606300 15746 raft_consensus.cc:482] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.606770 15746 raft_consensus.cc:504] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.608744 15746 leader_election.cc:288] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.609531 15603 raft_consensus.cc:482] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.613866 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:50.614404 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:50.615922 15402 leader_election.cc:341] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.615797 15745 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:50.610021 15603 raft_consensus.cc:504] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:50.616916 15404 leader_election.cc:341] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.617496 15404 leader_election.cc:302] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:50.618901 15745 raft_consensus.cc:2726] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:50.619035 15603 leader_election.cc:288] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.623662 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:50.622615 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.624377 15509 raft_consensus.cc:2454] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:50.625661 15744 raft_consensus.cc:482] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.626153 15745 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:50.626299 15744 raft_consensus.cc:504] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.627149 15555 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
W20260929 11:35:50.627492 15329 leader_election.cc:341] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.627832 15554 ts_tablet_manager.cc:1428] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.052s user 0.007s sys 0.000s
I20260929 11:35:50.627584 15555 ts_tablet_manager.cc:1397] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.069s user 0.020s sys 0.028s
I20260929 11:35:50.628731 15554 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:50.628726 15329 leader_election.cc:302] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:50.631433 15744 leader_election.cc:288] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:50.634657 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.635334 15436 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:50.632458 15715 raft_consensus.cc:2781] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:50.636915 15715 raft_consensus.cc:482] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:50.637226 15478 leader_election.cc:302] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:50.637707 15715 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.637538 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:50.638193 15361 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:50.639330 15744 raft_consensus.cc:2781] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:50.639695 15744 raft_consensus.cc:482] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:50.640002 15744 raft_consensus.cc:3037] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.646129 15553 tablet_bootstrap.cc:654] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.646848 15554 tablet_bootstrap.cc:654] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.743465 15641 raft_consensus.cc:482] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.744181 15641 raft_consensus.cc:504] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.746729 15641 leader_election.cc:288] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.776969 15555 raft_consensus.cc:348] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.777792 15555 raft_consensus.cc:374] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.778112 15555 raft_consensus.cc:729] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.778740 15555 consensus_queue.cc:260] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.779260 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.783499 15745 raft_consensus.cc:482] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.783970 15745 raft_consensus.cc:504] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.785821 15435 raft_consensus.cc:3037] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.785866 15745 leader_election.cc:288] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.787161 15744 raft_consensus.cc:504] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.790210 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:50.790817 15436 raft_consensus.cc:3037] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.797804 15436 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:50.798874 15478 leader_election.cc:302] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:50.799539 15706 raft_consensus.cc:482] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.799975 15706 raft_consensus.cc:504] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.800451 15555 ts_tablet_manager.cc:1428] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.172s user 0.014s sys 0.002s
I20260929 11:35:50.801913 15706 leader_election.cc:288] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:50.802414 15706 raft_consensus.cc:2781] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:50.802803 15706 raft_consensus.cc:686] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:50.803980 15706 consensus_queue.cc:237] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:50.805369 15329 leader_election.cc:341] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.808910 15555 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:50.809232 15715 raft_consensus.cc:504] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.811172 15715 leader_election.cc:288] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.814570 15603 raft_consensus.cc:482] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.814670 15715 raft_consensus.cc:482] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.815045 15603 raft_consensus.cc:504] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.815270 15715 raft_consensus.cc:504] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.811480 15744 leader_election.cc:288] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:50.834898 15603 leader_election.cc:288] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.821375 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:50.827504 15721 raft_consensus.cc:482] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.830408 15706 raft_consensus.cc:482] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.843880 15721 raft_consensus.cc:504] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.866815 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:50.866014 15329 leader_election.cc:341] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:50.843168 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 44365.3us
I20260929 11:35:50.871251 15553 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:50.871701 15553 ts_tablet_manager.cc:1397] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.295s user 0.026s sys 0.017s
I20260929 11:35:50.865298 15790 raft_consensus.cc:482] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.848502 15706 raft_consensus.cc:504] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.879489 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:50.881300 15361 raft_consensus.cc:3037] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.882440 15706 leader_election.cc:288] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:50.882676 15721 leader_election.cc:288] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.869402 15788 raft_consensus.cc:482] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.886062 15715 leader_election.cc:288] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.886848 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.888361 15362 raft_consensus.cc:3037] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.889431 15788 raft_consensus.cc:504] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.891047 15788 leader_election.cc:288] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:50.870903 15436 raft_consensus.cc:2454] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
W20260929 11:35:50.896777 15329 leader_election.cc:341] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.900441 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.900807 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5471502e24764effae2ab947ad5c8cb5" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:50.901918 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:50.903090 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.903966 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:50.904606 15511 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:50.905258 15478 leader_election.cc:341] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.906415 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96455e9e76c407ab71b312b680a9c93" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.907146 15555 tablet_bootstrap.cc:654] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.910002 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.910344 15509 raft_consensus.cc:3037] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.917368 15329 leader_election.cc:302] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
W20260929 11:35:50.920447 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:50.919876 15258 catalog_manager.cc:5495] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:50.920998 15715 raft_consensus.cc:2781] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:50.923738 15715 raft_consensus.cc:482] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:50.924110 15715 raft_consensus.cc:3037] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.883301 15790 raft_consensus.cc:504] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.935693 15715 raft_consensus.cc:504] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.938417 15553 raft_consensus.cc:348] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.939327 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5471502e24764effae2ab947ad5c8cb5" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:50.947942 15553 raft_consensus.cc:374] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.948370 15553 raft_consensus.cc:729] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.949016 15553 consensus_queue.cc:260] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.957522 15434 raft_consensus.cc:2454] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:50.963127 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18064e092cec4a5fbc144b23fcd5abaf" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:50.963467 15361 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
W20260929 11:35:50.966111 15329 leader_election.cc:341] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:50.971755 15788 consensus_queue.cc:1035] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:50.974013 15558 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:50.974740 15553 ts_tablet_manager.cc:1428] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.103s user 0.004s sys 0.003s
I20260929 11:35:50.975997 15553 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:50.976759 15790 leader_election.cc:288] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:50.978076 15715 leader_election.cc:288] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
W20260929 11:35:50.979457 15789 log.cc:924] Time spent T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260929 11:35:50.980950 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:50.981873 15554 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:50.982323 15554 ts_tablet_manager.cc:1397] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.354s user 0.018s sys 0.041s
I20260929 11:35:50.969731 15478 leader_election.cc:302] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:50.987084 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:50.987401 15554 raft_consensus.cc:348] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.987883 15435 raft_consensus.cc:3037] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:50.988140 15554 raft_consensus.cc:374] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:50.988492 15554 raft_consensus.cc:729] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:50.989212 15554 consensus_queue.cc:260] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:50.990965 15511 raft_consensus.cc:2454] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:50.993799 15554 ts_tablet_manager.cc:1428] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260929 11:35:50.995069 15554 tablet_bootstrap.cc:492] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:50.995180 15706 raft_consensus.cc:2781] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:50.995705 15790 raft_consensus.cc:482] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:50.998111 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.004570 15790 raft_consensus.cc:504] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.007403 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.007611 15438 raft_consensus.cc:3037] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.003149 15706 raft_consensus.cc:482] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:51.012748 15706 raft_consensus.cc:3037] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.027395 15555 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:51.028515 15553 tablet_bootstrap.cc:654] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:50.999747 15404 leader_election.cc:302] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:51.069684 15745 raft_consensus.cc:2726] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.082240 15706 raft_consensus.cc:504] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.108999 15508 raft_consensus.cc:2379] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79f6b689389549ce8079ff46fd514467 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:51.084208 15706 leader_election.cc:288] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:51.042384 15511 raft_consensus.cc:2454] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
W20260929 11:35:51.109783 15404 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 110119us
I20260929 11:35:51.122983 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:51.123643 15436 raft_consensus.cc:3037] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.203804 15436 raft_consensus.cc:2454] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:51.206703 15555 ts_tablet_manager.cc:1397] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.398s user 0.041s sys 0.044s
I20260929 11:35:51.212234 15790 leader_election.cc:288] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.211472 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:51.213555 15436 raft_consensus.cc:2454] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:51.216881 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18064e092cec4a5fbc144b23fcd5abaf" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.217549 15508 raft_consensus.cc:2454] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:51.220359 15435 raft_consensus.cc:2454] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:51.222124 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
W20260929 11:35:51.208514 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 53169.7us
I20260929 11:35:51.228153 15329 leader_election.cc:302] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:51.231659 15603 raft_consensus.cc:2781] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:35:51.232038 15603 raft_consensus.cc:482] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:51.232381 15603 raft_consensus.cc:3037] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:51.237864 15603 raft_consensus.cc:504] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.240470 15603 leader_election.cc:288] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.243763 15478 leader_election.cc:302] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:51.247541 15788 raft_consensus.cc:2781] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:51.248049 15788 raft_consensus.cc:686] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:51.248929 15788 consensus_queue.cc:237] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.254535 15786 consensus_queue.cc:1035] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:51.261655 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.262755 15554 tablet_bootstrap.cc:654] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.260571 15555 raft_consensus.cc:348] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.264472 15555 raft_consensus.cc:374] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.264904 15555 raft_consensus.cc:729] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.265705 15555 consensus_queue.cc:260] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.270177 15555 ts_tablet_manager.cc:1428] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.063s user 0.003s sys 0.003s
I20260929 11:35:51.271051 15555 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:51.274715 15553 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:51.275319 15553 ts_tablet_manager.cc:1397] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.300s user 0.010s sys 0.005s
W20260929 11:35:51.277213 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 49118.7us
I20260929 11:35:51.277878 15329 leader_election.cc:302] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:51.293828 15555 tablet_bootstrap.cc:654] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.296365 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:51.280773 15603 raft_consensus.cc:2781] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
W20260929 11:35:51.304659 15329 leader_election.cc:341] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.305029 15329 leader_election.cc:302] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:51.311205 15553 raft_consensus.cc:348] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.311933 15553 raft_consensus.cc:374] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.312188 15553 raft_consensus.cc:729] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.312796 15553 consensus_queue.cc:260] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.306939 15790 raft_consensus.cc:2726] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.298623 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:51.303723 15603 raft_consensus.cc:686] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
W20260929 11:35:51.317618 15329 leader_election.cc:341] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.317480 15603 consensus_queue.cc:237] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.318461 15329 leader_election.cc:302] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:51.319348 15790 raft_consensus.cc:2781] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:51.319486 15329 leader_election.cc:302] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:51.319818 15790 raft_consensus.cc:686] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:51.320624 15641 raft_consensus.cc:3037] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.320808 15329 leader_election.cc:302] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:51.324745 15803 raft_consensus.cc:2781] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:51.325204 15803 raft_consensus.cc:482] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:51.325564 15803 raft_consensus.cc:3037] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.327567 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:51.330739 15553 ts_tablet_manager.cc:1428] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.055s user 0.006s sys 0.002s
I20260929 11:35:51.327184 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:51.332921 15553 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:51.331670 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96455e9e76c407ab71b312b680a9c93" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:51.337980 15554 tablet_bootstrap.cc:492] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:51.338471 15554 ts_tablet_manager.cc:1397] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.344s user 0.017s sys 0.014s
I20260929 11:35:51.331470 15790 consensus_queue.cc:237] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.342154 15259 catalog_manager.cc:5495] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:51.343312 15554 raft_consensus.cc:348] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.347764 15554 raft_consensus.cc:374] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.348238 15554 raft_consensus.cc:729] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.414695 15554 consensus_queue.cc:260] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.417383 15553 tablet_bootstrap.cc:654] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:51.421061 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 98865.8us
I20260929 11:35:51.421742 15329 leader_election.cc:302] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
W20260929 11:35:51.423153 15329 leader_election.cc:341] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.424077 15803 raft_consensus.cc:504] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.425412 15603 raft_consensus.cc:2781] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:51.425818 15603 raft_consensus.cc:482] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:51.426115 15361 raft_consensus.cc:2379] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:51.426172 15603 raft_consensus.cc:3037] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.429584 15554 ts_tablet_manager.cc:1428] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.091s user 0.006s sys 0.004s
I20260929 11:35:51.431080 15554 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:51.437731 15641 raft_consensus.cc:2726] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.437954 15786 raft_consensus.cc:482] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:51.438946 15786 raft_consensus.cc:504] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.440958 15329 leader_election.cc:302] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:51.446434 15802 raft_consensus.cc:2726] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:35:51.447499 15555 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:51.447929 15555 ts_tablet_manager.cc:1397] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.177s user 0.030s sys 0.032s
I20260929 11:35:51.447417 15362 raft_consensus.cc:2454] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:51.451310 15363 raft_consensus.cc:1226] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Rejecting Update request from peer adf4734bb02e4108b00fabc552483a18 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260929 11:35:51.453456 15555 raft_consensus.cc:348] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.454562 15555 raft_consensus.cc:374] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.454841 15555 raft_consensus.cc:729] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.455600 15786 leader_election.cc:288] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:51.455449 15555 consensus_queue.cc:260] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.456537 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:51.456616 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:51.457993 15555 ts_tablet_manager.cc:1428] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
W20260929 11:35:51.458431 15478 leader_election.cc:341] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:51.458688 15329 leader_election.cc:341] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.464757 15803 leader_election.cc:288] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.464527 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:51.465764 15362 raft_consensus.cc:2454] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:51.467526 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:51.468125 15509 raft_consensus.cc:3037] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.469787 15603 raft_consensus.cc:504] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.472041 15603 leader_election.cc:288] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.472813 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18064e092cec4a5fbc144b23fcd5abaf" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:51.465782 15260 catalog_manager.cc:5495] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:51.474319 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18064e092cec4a5fbc144b23fcd5abaf" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:51.476886 15508 raft_consensus.cc:3037] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:51.477314 15329 leader_election.cc:341] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.476112 15509 raft_consensus.cc:2454] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:51.482019 15260 catalog_manager.cc:5495] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:51.483387 15476 leader_election.cc:302] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:51.484777 15508 raft_consensus.cc:2454] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:51.488210 15785 raft_consensus.cc:2726] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.485146 15476 leader_election.cc:302] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:51.492897 15785 raft_consensus.cc:2726] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.493511 15785 consensus_queue.cc:1046] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:51.494858 15785 consensus_queue.cc:1035] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260929 11:35:51.496809 15329 leader_election.cc:302] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:51.497970 15329 leader_election.cc:302] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:51.498998 15476 leader_election.cc:302] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:51.500747 15744 raft_consensus.cc:2781] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:51.499773 15803 raft_consensus.cc:2781] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:51.501138 15744 raft_consensus.cc:482] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:51.499874 15787 raft_consensus.cc:3032] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:35:51.501591 15744 raft_consensus.cc:3037] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.501632 15803 raft_consensus.cc:686] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:51.501638 15787 raft_consensus.cc:729] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:51.502782 15803 consensus_queue.cc:237] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.503623 15787 consensus_queue.cc:260] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.505853 15603 raft_consensus.cc:2781] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:51.507884 15603 raft_consensus.cc:686] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:51.506142 15787 raft_consensus.cc:3037] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:51.508752 15603 consensus_queue.cc:237] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.508024 15555 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:51.511417 15744 raft_consensus.cc:504] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.507359 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:51.530185 15555 tablet_bootstrap.cc:654] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.530256 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:51.531116 15362 raft_consensus.cc:3037] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.535398 15360 raft_consensus.cc:2454] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:51.535820 15554 tablet_bootstrap.cc:654] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.537173 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
W20260929 11:35:51.538550 15478 leader_election.cc:341] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.541364 15553 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:51.541965 15553 ts_tablet_manager.cc:1397] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.209s user 0.016s sys 0.010s
I20260929 11:35:51.532800 15744 leader_election.cc:288] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:51.551640 15553 raft_consensus.cc:348] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.561038 15553 raft_consensus.cc:374] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.561398 15553 raft_consensus.cc:729] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.562434 15553 consensus_queue.cc:260] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.565662 15553 ts_tablet_manager.cc:1428] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.023s user 0.006s sys 0.002s
I20260929 11:35:51.567205 15553 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:51.560672 15362 raft_consensus.cc:2454] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:51.572376 15476 leader_election.cc:302] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:51.576357 15744 raft_consensus.cc:2781] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:51.576876 15744 raft_consensus.cc:686] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:51.577601 15744 consensus_queue.cc:237] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.581025 15260 catalog_manager.cc:5495] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:51.587249 15553 tablet_bootstrap.cc:654] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.587604 15555 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:51.587092 15260 catalog_manager.cc:5495] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:51.588049 15555 ts_tablet_manager.cc:1397] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.080s user 0.014s sys 0.008s
I20260929 11:35:51.591161 15554 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:51.591636 15554 ts_tablet_manager.cc:1397] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.161s user 0.016s sys 0.014s
I20260929 11:35:51.596549 15554 raft_consensus.cc:348] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.597726 15554 raft_consensus.cc:374] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.598095 15554 raft_consensus.cc:729] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.601722 15706 consensus_queue.cc:1035] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:51.601965 15555 raft_consensus.cc:348] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.602733 15555 raft_consensus.cc:374] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.603108 15555 raft_consensus.cc:729] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.603787 15555 consensus_queue.cc:260] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.604130 15554 consensus_queue.cc:260] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.629352 15555 ts_tablet_manager.cc:1428] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.041s user 0.006s sys 0.000s
I20260929 11:35:51.631474 15259 catalog_manager.cc:5495] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:51.632642 15555 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:51.637512 15803 raft_consensus.cc:482] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:51.638047 15803 raft_consensus.cc:504] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.639189 15554 ts_tablet_manager.cc:1428] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.047s user 0.011s sys 0.003s
I20260929 11:35:51.639767 15553 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:51.640390 15553 ts_tablet_manager.cc:1397] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.073s user 0.014s sys 0.006s
I20260929 11:35:51.640592 15554 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:51.643002 15803 leader_election.cc:288] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.642840 15553 raft_consensus.cc:348] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.643522 15553 raft_consensus.cc:374] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.643811 15553 raft_consensus.cc:729] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.644361 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:51.644523 15553 consensus_queue.cc:260] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.645272 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:51.647836 15329 leader_election.cc:341] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.639838 15555 tablet_bootstrap.cc:654] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.681769 15792 raft_consensus.cc:482] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:51.682345 15792 raft_consensus.cc:504] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.692198 15792 leader_election.cc:288] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.725828 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.726248 15553 ts_tablet_manager.cc:1428] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.086s user 0.045s sys 0.040s
I20260929 11:35:51.726742 15508 raft_consensus.cc:2379] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:51.727185 15553 tablet_bootstrap.cc:492] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:51.726852 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:51.730063 15402 leader_election.cc:302] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:51.733106 15553 tablet_bootstrap.cc:654] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.734685 15795 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.738320 15553 tablet_bootstrap.cc:492] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:51.738722 15553 ts_tablet_manager.cc:1397] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
W20260929 11:35:51.740657 15329 leader_election.cc:341] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.740749 15553 raft_consensus.cc:348] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.741088 15329 leader_election.cc:302] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:51.741443 15553 raft_consensus.cc:374] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.741744 15553 raft_consensus.cc:729] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.742132 15803 raft_consensus.cc:2726] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.742290 15553 consensus_queue.cc:260] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.744256 15553 ts_tablet_manager.cc:1428] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260929 11:35:51.745107 15553 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:51.744750 15641 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:51.747005 15795 raft_consensus.cc:2726] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.748570 15706 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:51.760035 15553 tablet_bootstrap.cc:654] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.763827 15554 tablet_bootstrap.cc:654] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:51.778862 15329 consensus_peers.cc:487] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:51.778895 15555 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:51.782883 15603 raft_consensus.cc:482] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:51.783367 15603 raft_consensus.cc:504] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.785308 15603 leader_election.cc:288] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.784647 15641 raft_consensus.cc:482] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:51.786083 15641 raft_consensus.cc:504] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.786706 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:51.787441 15439 raft_consensus.cc:2454] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:51.789239 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.789397 15641 leader_election.cc:288] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.789875 15508 raft_consensus.cc:2454] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:51.791725 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a187e4fe114b97b83228cf0177ca13" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:51.792703 15745 raft_consensus.cc:482] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:51.793346 15745 raft_consensus.cc:504] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.794001 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a187e4fe114b97b83228cf0177ca13" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.795469 15329 leader_election.cc:302] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:51.796993 15603 raft_consensus.cc:2781] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:51.797323 15603 raft_consensus.cc:482] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:51.780783 15555 ts_tablet_manager.cc:1397] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.149s user 0.015s sys 0.011s
I20260929 11:35:51.797652 15603 raft_consensus.cc:3037] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.798029 15745 leader_election.cc:288] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.798657 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.799934 15555 raft_consensus.cc:348] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.800674 15555 raft_consensus.cc:374] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.800920 15555 raft_consensus.cc:729] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
W20260929 11:35:51.804678 15329 leader_election.cc:341] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:51.805733 15329 leader_election.cc:341] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.806066 15329 leader_election.cc:302] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:51.806694 15641 raft_consensus.cc:2726] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.804201 15603 raft_consensus.cc:504] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.810158 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:51.810701 15439 raft_consensus.cc:3037] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.821167 15439 raft_consensus.cc:2454] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:51.822192 15329 leader_election.cc:302] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:51.822885 15641 raft_consensus.cc:2781] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:51.823284 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:51.824043 15362 raft_consensus.cc:2379] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:51.822837 15553 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:51.824590 15553 ts_tablet_manager.cc:1397] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.080s user 0.028s sys 0.039s
I20260929 11:35:51.825579 15402 leader_election.cc:302] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:51.829702 15641 raft_consensus.cc:686] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:51.830605 15641 consensus_queue.cc:237] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.833436 15785 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:51.839591 15603 leader_election.cc:288] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.842801 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:51.843632 15509 raft_consensus.cc:3037] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.853024 15509 raft_consensus.cc:2454] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:51.856938 15745 raft_consensus.cc:3037] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.857283 15553 raft_consensus.cc:348] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.857990 15553 raft_consensus.cc:374] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.858316 15553 raft_consensus.cc:729] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.857896 15555 consensus_queue.cc:260] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.858950 15553 consensus_queue.cc:260] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.860678 15555 ts_tablet_manager.cc:1428] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.063s user 0.005s sys 0.000s
I20260929 11:35:51.861155 15553 ts_tablet_manager.cc:1428] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.036s user 0.016s sys 0.005s
I20260929 11:35:51.861575 15555 tablet_bootstrap.cc:492] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:51.861304 15717 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:51.862037 15553 tablet_bootstrap.cc:492] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:51.863529 15745 raft_consensus.cc:2726] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:51.874574 15260 catalog_manager.cc:5495] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:51.875844 15554 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:51.876688 15554 ts_tablet_manager.cc:1397] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.236s user 0.007s sys 0.020s
I20260929 11:35:51.879240 15555 tablet_bootstrap.cc:654] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.880373 15553 tablet_bootstrap.cc:654] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.880934 15554 raft_consensus.cc:348] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.886579 15554 raft_consensus.cc:374] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.887054 15554 raft_consensus.cc:729] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.892400 15554 consensus_queue.cc:260] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.894181 15721 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:51.895745 15554 ts_tablet_manager.cc:1428] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260929 11:35:51.896812 15554 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:51.900997 15553 tablet_bootstrap.cc:492] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:51.901463 15553 ts_tablet_manager.cc:1397] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.040s user 0.011s sys 0.006s
I20260929 11:35:51.904337 15554 tablet_bootstrap.cc:654] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.904783 15434 raft_consensus.cc:3037] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.905079 15553 raft_consensus.cc:348] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.905836 15553 raft_consensus.cc:374] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.906122 15553 raft_consensus.cc:729] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.906728 15553 consensus_queue.cc:260] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.912295 15553 ts_tablet_manager.cc:1428] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.011s user 0.005s sys 0.003s
I20260929 11:35:51.913067 15553 tablet_bootstrap.cc:492] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:51.916849 15721 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:51.922765 15553 tablet_bootstrap.cc:654] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.923316 15795 raft_consensus.cc:482] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:51.923815 15795 raft_consensus.cc:504] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.925886 15795 leader_election.cc:288] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.928086 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:51.928776 15360 raft_consensus.cc:2454] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:51.929973 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:51.931012 15402 leader_election.cc:302] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
W20260929 11:35:51.932158 15404 leader_election.cc:341] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.933336 15745 raft_consensus.cc:2781] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:51.933701 15745 raft_consensus.cc:482] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:51.934067 15745 raft_consensus.cc:3037] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.944761 15745 raft_consensus.cc:504] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.951574 15803 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:51.952196 15554 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:51.954001 15554 ts_tablet_manager.cc:1397] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.057s user 0.010s sys 0.003s
I20260929 11:35:51.956501 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:51.957094 15360 raft_consensus.cc:3037] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:51.958112 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
W20260929 11:35:51.959647 15404 leader_election.cc:341] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:51.962045 15745 leader_election.cc:288] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:51.961810 15554 raft_consensus.cc:348] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.965404 15554 raft_consensus.cc:374] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:51.965189 15785 consensus_queue.cc:1035] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:51.965749 15554 raft_consensus.cc:729] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:51.966572 15554 consensus_queue.cc:260] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:51.969875 15554 ts_tablet_manager.cc:1428] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260929 11:35:51.971132 15554 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:51.984875 15554 tablet_bootstrap.cc:654] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:51.990705 15744 consensus_queue.cc:1035] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:52.000689 15553 tablet_bootstrap.cc:492] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:52.001196 15553 ts_tablet_manager.cc:1397] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.088s user 0.030s sys 0.030s
I20260929 11:35:52.003423 15554 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.004055 15554 ts_tablet_manager.cc:1397] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.006s
I20260929 11:35:52.007673 15554 raft_consensus.cc:348] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.008455 15554 raft_consensus.cc:374] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.008716 15554 raft_consensus.cc:729] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.010814 15795 raft_consensus.cc:482] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.011369 15795 raft_consensus.cc:504] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.013331 15795 leader_election.cc:288] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.009389 15554 consensus_queue.cc:260] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.014400 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:52.015884 15404 leader_election.cc:341] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.015960 15554 ts_tablet_manager.cc:1428] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260929 11:35:52.017552 15554 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:52.008948 15553 raft_consensus.cc:348] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.020918 15553 raft_consensus.cc:374] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.021211 15553 raft_consensus.cc:729] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.021832 15553 consensus_queue.cc:260] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.022454 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.023365 15553 ts_tablet_manager.cc:1428] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.022s user 0.004s sys 0.000s
I20260929 11:35:52.024236 15553 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:52.025339 15744 raft_consensus.cc:482] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.026201 15744 raft_consensus.cc:504] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:52.028302 15402 leader_election.cc:341] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.028954 15402 leader_election.cc:302] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.030359 15795 raft_consensus.cc:2726] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:52.028357 15554 tablet_bootstrap.cc:654] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.033331 15744 leader_election.cc:288] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:52.033595 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85688ae966734650b9fca8130f2feb8c" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.035306 15553 tablet_bootstrap.cc:654] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.035219 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85688ae966734650b9fca8130f2feb8c" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:52.036602 15478 leader_election.cc:341] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:52.037619 15476 leader_election.cc:341] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.038017 15476 leader_election.cc:302] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:52.039045 15744 raft_consensus.cc:2726] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:52.042565 15555 tablet_bootstrap.cc:492] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.042997 15555 ts_tablet_manager.cc:1397] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.182s user 0.010s sys 0.002s
I20260929 11:35:52.031236 15360 raft_consensus.cc:2454] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:52.040405 15795 raft_consensus.cc:482] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.058432 15402 leader_election.cc:302] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.060076 15745 raft_consensus.cc:2781] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
W20260929 11:35:52.067574 15329 consensus_peers.cc:487] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:52.056422 15795 raft_consensus.cc:504] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.069231 15553 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:52.069684 15553 ts_tablet_manager.cc:1397] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.046s user 0.011s sys 0.000s
I20260929 11:35:52.072060 15795 leader_election.cc:288] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.075851 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f3d509852942e2b45c13e1f5c5ea8d" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.071820 15721 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260929 11:35:52.079190 15745 raft_consensus.cc:686] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:52.075865 15795 raft_consensus.cc:482] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.079862 15795 raft_consensus.cc:504] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.080101 15745 consensus_queue.cc:237] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.081830 15795 leader_election.cc:288] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.083329 15554 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.084678 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f3d509852942e2b45c13e1f5c5ea8d" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.085319 15360 raft_consensus.cc:2454] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:52.087797 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.089565 15402 leader_election.cc:302] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:52.094414 15554 ts_tablet_manager.cc:1397] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.016s
I20260929 11:35:52.095827 15553 raft_consensus.cc:348] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.096930 15553 raft_consensus.cc:374] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 11:35:52.097492 15404 leader_election.cc:341] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.097693 15553 raft_consensus.cc:729] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.098428 15553 consensus_queue.cc:260] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.101421 15553 ts_tablet_manager.cc:1428] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.031s user 0.007s sys 0.000s
I20260929 11:35:52.102480 15553 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:52.096418 15555 raft_consensus.cc:348] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.105912 15555 raft_consensus.cc:374] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.106295 15555 raft_consensus.cc:729] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.107105 15555 consensus_queue.cc:260] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.112023 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:52.112090 15402 leader_election.cc:341] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.112035 15706 raft_consensus.cc:482] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:35:52.114285 15404 leader_election.cc:341] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.114223 15706 raft_consensus.cc:504] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.114770 15404 leader_election.cc:302] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.116501 15792 raft_consensus.cc:2726] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:52.116814 15706 leader_election.cc:288] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:52.120417 15554 raft_consensus.cc:348] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.121326 15554 raft_consensus.cc:374] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.121587 15554 raft_consensus.cc:729] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.121690 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.125427 15555 ts_tablet_manager.cc:1428] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.077s user 0.006s sys 0.006s
I20260929 11:35:52.126279 15555 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.132264 15554 consensus_queue.cc:260] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.132220 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.134208 15717 raft_consensus.cc:482] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.135715 15717 raft_consensus.cc:504] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.137665 15717 leader_election.cc:288] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.138377 15553 tablet_bootstrap.cc:654] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.109129 15844 raft_consensus.cc:2781] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:52.140597 15258 catalog_manager.cc:5495] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:52.142552 15478 leader_election.cc:302] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:52.142822 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.144043 15788 raft_consensus.cc:2726] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:35:52.145370 15329 leader_election.cc:341] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.146180 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.146795 15436 raft_consensus.cc:2454] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:52.150594 15844 raft_consensus.cc:482] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.151974 15513 raft_consensus.cc:3037] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.151235 15329 leader_election.cc:302] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.155751 15721 raft_consensus.cc:2781] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:52.156072 15721 raft_consensus.cc:482] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.156417 15721 raft_consensus.cc:3037] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.156795 15555 tablet_bootstrap.cc:654] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.152209 15554 ts_tablet_manager.cc:1428] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.057s user 0.003s sys 0.003s
I20260929 11:35:52.160032 15554 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:52.153596 15844 raft_consensus.cc:3037] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.163116 15721 raft_consensus.cc:504] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.170715 15844 raft_consensus.cc:504] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.171378 15554 tablet_bootstrap.cc:654] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.174060 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f3d509852942e2b45c13e1f5c5ea8d" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:52.174671 15360 raft_consensus.cc:3037] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.174664 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:52.176582 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f3d509852942e2b45c13e1f5c5ea8d" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
W20260929 11:35:52.177923 15404 leader_election.cc:341] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.179209 15844 leader_election.cc:288] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
W20260929 11:35:52.180666 15329 leader_election.cc:341] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.181581 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:52.185675 15434 raft_consensus.cc:3037] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.185618 15360 raft_consensus.cc:2454] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:52.181131 15721 leader_election.cc:288] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.197906 15402 leader_election.cc:302] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.198627 15555 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.198734 15844 raft_consensus.cc:2781] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.199168 15555 ts_tablet_manager.cc:1397] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.073s user 0.007s sys 0.003s
I20260929 11:35:52.191819 15434 raft_consensus.cc:2454] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:52.199232 15844 raft_consensus.cc:686] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:52.201896 15555 raft_consensus.cc:348] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.202605 15555 raft_consensus.cc:374] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.202876 15555 raft_consensus.cc:729] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.202471 15844 consensus_queue.cc:237] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.203963 15329 leader_election.cc:302] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.204270 15553 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:52.204746 15553 ts_tablet_manager.cc:1397] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.103s user 0.011s sys 0.002s
I20260929 11:35:52.204998 15717 raft_consensus.cc:2781] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.205471 15717 raft_consensus.cc:686] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:52.212149 15553 raft_consensus.cc:348] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.213387 15553 raft_consensus.cc:374] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.213688 15553 raft_consensus.cc:729] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.214373 15553 consensus_queue.cc:260] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.216539 15553 ts_tablet_manager.cc:1428] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20260929 11:35:52.206442 15717 consensus_queue.cc:237] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.223901 15553 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:52.223877 15555 consensus_queue.cc:260] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.226410 15258 catalog_manager.cc:5495] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:52.230822 15555 ts_tablet_manager.cc:1428] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260929 11:35:52.231629 15555 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.232829 15803 raft_consensus.cc:482] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.233424 15803 raft_consensus.cc:504] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.237423 15555 tablet_bootstrap.cc:654] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.241400 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.241662 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:52.243789 15329 leader_election.cc:341] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:52.244455 15329 leader_election.cc:341] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.240634 15803 leader_election.cc:288] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.244817 15329 leader_election.cc:302] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.249388 15803 raft_consensus.cc:2726] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:52.255667 15553 tablet_bootstrap.cc:654] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.262792 15555 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.262920 15554 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.263242 15555 ts_tablet_manager.cc:1397] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.002s
I20260929 11:35:52.263501 15554 ts_tablet_manager.cc:1397] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.104s user 0.014s sys 0.019s
I20260929 11:35:52.265266 15260 catalog_manager.cc:5495] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:52.266136 15555 raft_consensus.cc:348] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.266822 15555 raft_consensus.cc:374] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 11:35:52.267009 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:52.267077 15555 raft_consensus.cc:729] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.266034 15554 raft_consensus.cc:348] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.268062 15554 raft_consensus.cc:374] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.268361 15554 raft_consensus.cc:729] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.267956 15555 consensus_queue.cc:260] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.268942 15554 consensus_queue.cc:260] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.272908 15554 ts_tablet_manager.cc:1428] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260929 11:35:52.274402 15554 tablet_bootstrap.cc:492] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:52.275719 15553 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:52.275871 15555 ts_tablet_manager.cc:1428] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260929 11:35:52.276232 15553 ts_tablet_manager.cc:1397] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.057s user 0.013s sys 0.002s
I20260929 11:35:52.276790 15555 tablet_bootstrap.cc:492] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.281433 15554 tablet_bootstrap.cc:654] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.281554 15553 raft_consensus.cc:348] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.282305 15553 raft_consensus.cc:374] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.282582 15553 raft_consensus.cc:729] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.283046 15553 consensus_queue.cc:260] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.288493 15553 ts_tablet_manager.cc:1428] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260929 11:35:52.289551 15803 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:52.292017 15555 tablet_bootstrap.cc:654] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.297770 15553 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:52.302641 15554 tablet_bootstrap.cc:492] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.303113 15554 ts_tablet_manager.cc:1397] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.000s
I20260929 11:35:52.304998 15555 tablet_bootstrap.cc:492] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.305661 15555 ts_tablet_manager.cc:1397] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.003s
I20260929 11:35:52.305365 15554 raft_consensus.cc:348] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.306159 15554 raft_consensus.cc:374] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.306423 15554 raft_consensus.cc:729] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.307310 15554 consensus_queue.cc:260] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.308387 15555 raft_consensus.cc:348] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.309122 15555 raft_consensus.cc:374] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.309353 15554 ts_tablet_manager.cc:1428] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260929 11:35:52.309412 15555 raft_consensus.cc:729] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.310352 15555 consensus_queue.cc:260] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.311066 15721 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:52.312917 15555 ts_tablet_manager.cc:1428] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260929 11:35:52.313645 15554 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:52.316977 15555 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.319847 15554 tablet_bootstrap.cc:654] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.325629 15555 tablet_bootstrap.cc:654] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.343889 15554 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.344478 15554 ts_tablet_manager.cc:1397] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.003s
I20260929 11:35:52.349871 15554 raft_consensus.cc:348] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.351366 15554 raft_consensus.cc:374] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.351672 15554 raft_consensus.cc:729] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.352523 15554 consensus_queue.cc:260] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.355039 15553 tablet_bootstrap.cc:654] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.355746 15555 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.356245 15555 ts_tablet_manager.cc:1397] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.039s user 0.019s sys 0.010s
I20260929 11:35:52.358059 15554 ts_tablet_manager.cc:1428] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.013s user 0.002s sys 0.004s
I20260929 11:35:52.359319 15554 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:52.359254 15555 raft_consensus.cc:348] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.360077 15555 raft_consensus.cc:374] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.360366 15555 raft_consensus.cc:729] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.361182 15555 consensus_queue.cc:260] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.363214 15555 ts_tablet_manager.cc:1428] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260929 11:35:52.364283 15555 tablet_bootstrap.cc:492] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.367065 15553 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:52.367528 15553 ts_tablet_manager.cc:1397] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.070s user 0.007s sys 0.009s
I20260929 11:35:52.370271 15553 raft_consensus.cc:348] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.370957 15553 raft_consensus.cc:374] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.371209 15553 raft_consensus.cc:729] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.371794 15553 consensus_queue.cc:260] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.377995 15553 ts_tablet_manager.cc:1428] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260929 11:35:52.382897 15554 tablet_bootstrap.cc:654] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.383975 15803 raft_consensus.cc:482] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.384780 15553 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:52.384480 15803 raft_consensus.cc:504] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.385922 15555 tablet_bootstrap.cc:654] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.388520 15803 leader_election.cc:288] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.389144 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85688ae966734650b9fca8130f2feb8c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.390552 15434 raft_consensus.cc:2454] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:52.390549 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85688ae966734650b9fca8130f2feb8c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.391330 15513 raft_consensus.cc:2454] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:52.391727 15329 leader_election.cc:302] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:52.392467 15804 raft_consensus.cc:2781] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:52.392804 15804 raft_consensus.cc:482] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.393113 15804 raft_consensus.cc:3037] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.401752 15553 tablet_bootstrap.cc:654] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.402597 15554 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.403256 15554 ts_tablet_manager.cc:1397] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.011s
I20260929 11:35:52.405077 15554 raft_consensus.cc:348] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.405660 15554 raft_consensus.cc:374] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.405925 15554 raft_consensus.cc:729] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.406567 15554 consensus_queue.cc:260] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.409037 15554 ts_tablet_manager.cc:1428] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260929 11:35:52.411841 15554 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:52.404102 15804 raft_consensus.cc:504] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.416930 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85688ae966734650b9fca8130f2feb8c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:52.417531 15434 raft_consensus.cc:3037] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.418496 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85688ae966734650b9fca8130f2feb8c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:52.435372 15554 tablet_bootstrap.cc:654] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.432368 15553 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:52.436046 15553 ts_tablet_manager.cc:1397] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.000s
I20260929 11:35:52.435416 15513 raft_consensus.cc:3037] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.439433 15553 raft_consensus.cc:348] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.440167 15553 raft_consensus.cc:374] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.440528 15553 raft_consensus.cc:729] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.441102 15553 consensus_queue.cc:260] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.443305 15553 ts_tablet_manager.cc:1428] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260929 11:35:52.447814 15553 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:52.418067 15804 leader_election.cc:288] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.434659 15555 tablet_bootstrap.cc:492] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.450709 15555 ts_tablet_manager.cc:1397] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.087s user 0.023s sys 0.011s
I20260929 11:35:52.455375 15555 raft_consensus.cc:348] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.458858 15555 raft_consensus.cc:374] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.459079 15555 raft_consensus.cc:729] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.459654 15555 consensus_queue.cc:260] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.460769 15844 raft_consensus.cc:482] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.461478 15553 tablet_bootstrap.cc:654] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.461390 15844 raft_consensus.cc:504] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.463301 15844 leader_election.cc:288] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.464306 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a187e4fe114b97b83228cf0177ca13" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.463945 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a187e4fe114b97b83228cf0177ca13" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.465126 15360 raft_consensus.cc:2454] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:52.465387 15555 ts_tablet_manager.cc:1428] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.014s user 0.003s sys 0.003s
W20260929 11:35:52.465917 15404 leader_election.cc:341] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.466246 15555 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.467097 15402 leader_election.cc:302] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.468643 15745 raft_consensus.cc:2781] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:52.469033 15745 raft_consensus.cc:482] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.469380 15745 raft_consensus.cc:3037] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.471424 15513 raft_consensus.cc:2454] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:52.471756 15555 tablet_bootstrap.cc:654] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.431712 15434 raft_consensus.cc:2454] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:52.474352 15329 leader_election.cc:302] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:52.475170 15717 raft_consensus.cc:2781] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.475642 15717 raft_consensus.cc:686] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:52.476466 15717 consensus_queue.cc:237] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.488730 15555 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.489219 15555 ts_tablet_manager.cc:1397] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.023s user 0.015s sys 0.002s
I20260929 11:35:52.489408 15745 raft_consensus.cc:504] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.474563 15554 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.492865 15554 ts_tablet_manager.cc:1397] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.081s user 0.027s sys 0.002s
I20260929 11:35:52.493705 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a187e4fe114b97b83228cf0177ca13" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:52.494314 15360 raft_consensus.cc:3037] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.495026 15555 raft_consensus.cc:348] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.495733 15555 raft_consensus.cc:374] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.495985 15555 raft_consensus.cc:729] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.496031 15554 raft_consensus.cc:348] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.496804 15554 raft_consensus.cc:374] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.497165 15554 raft_consensus.cc:729] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.497795 15554 consensus_queue.cc:260] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.499050 15788 raft_consensus.cc:482] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.499482 15788 raft_consensus.cc:504] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.499960 15554 ts_tablet_manager.cc:1428] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260929 11:35:52.492865 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a187e4fe114b97b83228cf0177ca13" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:52.500408 15745 leader_election.cc:288] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.496752 15555 consensus_queue.cc:260] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:52.501298 15404 leader_election.cc:341] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.501539 15788 leader_election.cc:288] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:52.502483 15554 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:52.502696 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.504140 15717 raft_consensus.cc:482] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.504602 15717 raft_consensus.cc:504] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.505069 15804 raft_consensus.cc:482] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.505640 15804 raft_consensus.cc:504] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.506413 15717 leader_election.cc:288] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.506196 15360 raft_consensus.cc:2454] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:52.507946 15804 leader_election.cc:288] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.505069 15555 ts_tablet_manager.cc:1428] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260929 11:35:52.508289 15402 leader_election.cc:302] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.509550 15555 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.509488 15745 raft_consensus.cc:2781] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.510177 15745 raft_consensus.cc:686] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:52.511000 15745 consensus_queue.cc:237] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.512109 15554 tablet_bootstrap.cc:654] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.515739 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.517185 15555 tablet_bootstrap.cc:654] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.520468 15788 raft_consensus.cc:482] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.499891 15553 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:52.521112 15788 raft_consensus.cc:504] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.521723 15553 ts_tablet_manager.cc:1397] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.074s user 0.013s sys 0.003s
I20260929 11:35:52.522454 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.523514 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.523787 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f3d509852942e2b45c13e1f5c5ea8d" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.524145 15434 raft_consensus.cc:2454] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:52.524869 15363 raft_consensus.cc:2379] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 2b2ed85c4da64515a0664b6c0421e078 in this term.
I20260929 11:35:52.525925 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:52.526170 15329 leader_election.cc:341] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.529531 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f3d509852942e2b45c13e1f5c5ea8d" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:52.530181 15329 leader_election.cc:341] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.530618 15329 leader_election.cc:302] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.531273 15804 raft_consensus.cc:2726] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:52.531315 15478 leader_election.cc:302] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:52.531598 15329 leader_election.cc:302] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:52.532248 15804 raft_consensus.cc:2781] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260929 11:35:52.532449 15329 leader_election.cc:341] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.532691 15804 raft_consensus.cc:482] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.532498 15553 raft_consensus.cc:348] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.533028 15706 raft_consensus.cc:3037] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.533123 15804 raft_consensus.cc:3037] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.533298 15553 raft_consensus.cc:374] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.533618 15553 raft_consensus.cc:729] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.534539 15553 consensus_queue.cc:260] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.536734 15553 ts_tablet_manager.cc:1428] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260929 11:35:52.537748 15553 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:52.541888 15706 raft_consensus.cc:2726] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:52.542538 15788 leader_election.cc:288] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:52.542649 15260 catalog_manager.cc:5495] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:52.543581 15553 tablet_bootstrap.cc:654] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.546612 15555 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.547328 15745 raft_consensus.cc:482] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.547982 15555 ts_tablet_manager.cc:1397] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.010s
I20260929 11:35:52.547832 15745 raft_consensus.cc:504] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.550484 15554 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.550979 15554 ts_tablet_manager.cc:1397] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.049s user 0.008s sys 0.004s
I20260929 11:35:52.541747 15804 raft_consensus.cc:504] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.552600 15745 leader_election.cc:288] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.552850 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.553551 15363 raft_consensus.cc:2454] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:52.555150 15509 raft_consensus.cc:3037] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.533643 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.557574 15804 leader_election.cc:288] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.557897 15360 raft_consensus.cc:2379] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 2b2ed85c4da64515a0664b6c0421e078 in this term.
I20260929 11:35:52.555337 15555 raft_consensus.cc:348] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.559404 15555 raft_consensus.cc:374] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.560065 15555 raft_consensus.cc:729] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.562330 15555 consensus_queue.cc:260] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.564759 15402 leader_election.cc:302] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:52.564776 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.565595 15513 raft_consensus.cc:2454] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:52.568955 15555 ts_tablet_manager.cc:1428] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.020s user 0.006s sys 0.001s
I20260929 11:35:52.570453 15554 raft_consensus.cc:348] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.571306 15554 raft_consensus.cc:374] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.571645 15554 raft_consensus.cc:729] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.572129 15555 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.573958 15844 raft_consensus.cc:2781] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:52.574421 15844 raft_consensus.cc:482] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.574843 15844 raft_consensus.cc:3037] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.576608 15804 raft_consensus.cc:482] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.577535 15804 raft_consensus.cc:504] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.579428 15804 leader_election.cc:288] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.579696 15706 raft_consensus.cc:482] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.580209 15706 raft_consensus.cc:504] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.582096 15706 leader_election.cc:288] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:52.582811 15844 raft_consensus.cc:504] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.583376 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ab10cacb2684573bce3212170485cda" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:52.585453 15478 leader_election.cc:341] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.581694 15745 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260929 11:35:52.586344 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:52.587219 15363 raft_consensus.cc:3037] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.589049 15555 tablet_bootstrap.cc:654] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.589545 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:52.591114 15509 raft_consensus.cc:3037] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.591261 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:52.592106 15436 raft_consensus.cc:3037] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.595523 15844 leader_election.cc:288] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.546475 15258 catalog_manager.cc:5495] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:52.599920 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.601374 15554 consensus_queue.cc:260] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:52.604022 15329 leader_election.cc:341] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.607079 15436 raft_consensus.cc:2454] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:52.609140 15363 raft_consensus.cc:2454] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:52.609366 15554 ts_tablet_manager.cc:1428] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.058s user 0.006s sys 0.002s
I20260929 11:35:52.610313 15554 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:52.610231 15402 leader_election.cc:302] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:52.611069 15795 raft_consensus.cc:482] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.611495 15795 raft_consensus.cc:504] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.612182 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ab10cacb2684573bce3212170485cda" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.612756 15792 raft_consensus.cc:2781] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.612828 15362 raft_consensus.cc:2454] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:52.613516 15795 leader_election.cc:288] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.614980 15872 raft_consensus.cc:482] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.614975 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:52.616783 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.617414 15508 raft_consensus.cc:2454] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:52.615547 15872 raft_consensus.cc:504] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.618609 15404 leader_election.cc:302] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:52.622467 15745 raft_consensus.cc:2781] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:52.622891 15745 raft_consensus.cc:482] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.623204 15745 raft_consensus.cc:3037] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.626760 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f281c33521294dbdac740fec2f2b0b51" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.627084 15476 leader_election.cc:302] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
W20260929 11:35:52.628367 15478 leader_election.cc:341] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.629248 15555 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.626796 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:52.629670 15555 ts_tablet_manager.cc:1397] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.059s user 0.012s sys 0.000s
I20260929 11:35:52.630311 15792 raft_consensus.cc:686] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:52.631675 15792 consensus_queue.cc:237] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.632658 15844 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:52.632771 15555 raft_consensus.cc:348] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.634678 15476 leader_election.cc:302] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:52.636761 15788 raft_consensus.cc:2781] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:52.637121 15788 raft_consensus.cc:482] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.637424 15788 raft_consensus.cc:3037] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.642937 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.643242 15436 raft_consensus.cc:3037] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.643639 15360 raft_consensus.cc:2454] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:52.647886 15553 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:52.648517 15553 ts_tablet_manager.cc:1397] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.111s user 0.027s sys 0.034s
I20260929 11:35:52.645123 15872 leader_election.cc:288] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:52.645066 15788 raft_consensus.cc:504] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.633546 15555 raft_consensus.cc:374] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.652153 15555 raft_consensus.cc:729] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.651522 15745 raft_consensus.cc:504] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.647846 15329 leader_election.cc:302] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:52.654608 15788 leader_election.cc:288] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:52.655730 15804 raft_consensus.cc:2781] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.655627 15553 raft_consensus.cc:348] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.656256 15804 raft_consensus.cc:686] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:52.656723 15553 raft_consensus.cc:374] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.656340 15363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f281c33521294dbdac740fec2f2b0b51" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:52.657306 15553 raft_consensus.cc:729] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.657469 15363 raft_consensus.cc:2454] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:52.658010 15553 consensus_queue.cc:260] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.659015 15745 leader_election.cc:288] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.660243 15553 ts_tablet_manager.cc:1428] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260929 11:35:52.657572 15804 consensus_queue.cc:237] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.660774 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:52.661391 15553 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:52.661329 15513 raft_consensus.cc:3037] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.661885 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:52.662458 15360 raft_consensus.cc:3037] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.665216 15476 leader_election.cc:302] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:52.667289 15555 consensus_queue.cc:260] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.675086 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ab10cacb2684573bce3212170485cda" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:52.669775 15872 raft_consensus.cc:2781] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:52.682840 15555 ts_tablet_manager.cc:1428] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.053s user 0.008s sys 0.000s
I20260929 11:35:52.683918 15555 tablet_bootstrap.cc:492] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
W20260929 11:35:52.684612 15478 leader_election.cc:341] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.680378 15872 raft_consensus.cc:482] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:52.685510 15706 raft_consensus.cc:2726] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:52.718549 15555 tablet_bootstrap.cc:654] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.731040 15509 raft_consensus.cc:2454] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
W20260929 11:35:52.742034 15329 leader_election.cc:341] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:52.744885 15329 leader_election.cc:341] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:52.745311 15329 leader_election.cc:302] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:52.722504 15872 raft_consensus.cc:3037] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.719941 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ab10cacb2684573bce3212170485cda" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:52.732203 15360 raft_consensus.cc:2454] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:52.750723 15717 raft_consensus.cc:2726] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:52.775712 15362 raft_consensus.cc:3037] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.792362 15258 catalog_manager.cc:5495] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:52.796120 15881 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.799721 15881 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.801671 15881 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
W20260929 11:35:52.821055 15877 log.cc:924] Time spent T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18: Append to log took a long time: real 0.100s user 0.001s sys 0.000s
I20260929 11:35:52.796120 15883 consensus_queue.cc:1035] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260929 11:35:52.823686 15513 raft_consensus.cc:2454] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:52.831673 15404 leader_election.cc:302] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:52.832566 15745 raft_consensus.cc:2781] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.833014 15745 raft_consensus.cc:686] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:52.833772 15745 consensus_queue.cc:237] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.844017 15554 tablet_bootstrap.cc:654] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.838967 15260 catalog_manager.cc:5495] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:52.849857 15362 raft_consensus.cc:2454] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:52.855647 15555 tablet_bootstrap.cc:492] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:52.856302 15555 ts_tablet_manager.cc:1397] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.173s user 0.038s sys 0.035s
I20260929 11:35:52.850535 15553 tablet_bootstrap.cc:654] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:52.865872 15872 raft_consensus.cc:504] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.858992 15844 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260929 11:35:52.877322 15555 raft_consensus.cc:348] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.880013 15555 raft_consensus.cc:374] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:52.880405 15555 raft_consensus.cc:729] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:52.881161 15555 consensus_queue.cc:260] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.890789 15795 raft_consensus.cc:482] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
I20260929 11:35:52.871245 15872 leader_election.cc:288] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:52.891350 15795 raft_consensus.cc:504] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.892531 15555 ts_tablet_manager.cc:1428] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.036s user 0.008s sys 0.000s
I20260929 11:35:52.893428 15795 leader_election.cc:288] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.893647 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f281c33521294dbdac740fec2f2b0b51" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:52.894182 15439 raft_consensus.cc:3037] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:52.893445 15555 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:52.903726 15439 raft_consensus.cc:2454] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:52.889204 15803 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.898311 15844 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.915107 15476 leader_election.cc:302] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:52.889359 15436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:52.916991 15881 raft_consensus.cc:2781] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.917496 15881 raft_consensus.cc:686] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:52.919802 15478 leader_election.cc:302] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:52.912608 15803 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.920660 15706 raft_consensus.cc:482] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:52.967607 15872 raft_consensus.cc:2781] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:52.916224 15844 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.990851 15554 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:52.994359 15554 ts_tablet_manager.cc:1397] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.384s user 0.022s sys 0.001s
I20260929 11:35:53.004099 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:53.004920 15359 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:53.005170 15436 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:53.007187 15357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f281c33521294dbdac740fec2f2b0b51" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:53.007978 15357 raft_consensus.cc:3037] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:53.015609 15329 consensus_peers.cc:487] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:52.989666 15844 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:52.988293 15872 raft_consensus.cc:686] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:52.991328 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:53.021976 15803 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.021855 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:53.026232 15872 consensus_queue.cc:237] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:52.974280 15706 raft_consensus.cc:504] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.032068 15509 raft_consensus.cc:2454] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:35:53.030453 15506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:53.020342 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 100629us
I20260929 11:35:53.036468 15478 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:53.036401 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:53.031522 15893 raft_consensus.cc:482] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:53.051035 15404 leader_election.cc:302] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:53.037575 15507 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:53.069351 15553 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:53.069883 15553 ts_tablet_manager.cc:1397] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.409s user 0.016s sys 0.006s
I20260929 11:35:53.074669 15876 raft_consensus.cc:2781] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:35:53.075260 15876 raft_consensus.cc:482] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
I20260929 11:35:53.075733 15876 raft_consensus.cc:3037] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:53.074348 15795 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:53.084277 15706 leader_election.cc:288] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:53.094522 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:53.095428 15437 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:53.100455 15329 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.065703 15893 raft_consensus.cc:504] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.055727 15355 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:53.104188 15554 raft_consensus.cc:348] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.109740 15717 raft_consensus.cc:2781] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:53.109803 15893 leader_election.cc:288] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.039855 15881 consensus_queue.cc:237] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.111558 15554 raft_consensus.cc:374] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.118698 15555 tablet_bootstrap.cc:654] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:53.118702 15554 raft_consensus.cc:729] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:53.127491 15554 consensus_queue.cc:260] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.131675 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:53.132889 15361 raft_consensus.cc:2379] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 2: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:53.132788 15553 raft_consensus.cc:348] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.133817 15553 raft_consensus.cc:374] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.134145 15553 raft_consensus.cc:729] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:53.134892 15553 consensus_queue.cc:260] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.129179 15404 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:53.141599 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a187e4fe114b97b83228cf0177ca13" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:53.142113 15844 raft_consensus.cc:2781] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:53.142665 15844 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:53.143117 15844 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.147228 15554 ts_tablet_manager.cc:1428] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.153s user 0.011s sys 0.000s
I20260929 11:35:53.148113 15554 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:53.155323 15553 ts_tablet_manager.cc:1428] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.085s user 0.006s sys 0.001s
I20260929 11:35:53.157215 15553 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:53.149770 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:53.157151 15258 catalog_manager.cc:5495] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:53.160373 15433 raft_consensus.cc:2454] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:53.160935 15717 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:53.161345 15717 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.165421 15892 raft_consensus.cc:2781] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260929 11:35:53.185070 15476 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 146969us
I20260929 11:35:53.196811 15892 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:53.197362 15892 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.209458 15717 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.211475 15717 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.196054 15357 raft_consensus.cc:2454] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:53.227661 15876 raft_consensus.cc:504] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.234277 15876 leader_election.cc:288] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.241647 15892 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.280313 15554 tablet_bootstrap.cc:654] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:53.286371 15892 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:53.228087 15844 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.295738 15555 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:53.296238 15555 ts_tablet_manager.cc:1397] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.403s user 0.022s sys 0.004s
I20260929 11:35:53.299830 15896 raft_consensus.cc:482] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:53.301236 15553 tablet_bootstrap.cc:654] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:53.299949 15507 raft_consensus.cc:3037] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.320071 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5a187e4fe114b97b83228cf0177ca13" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:53.321292 15355 raft_consensus.cc:2379] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 2b2ed85c4da64515a0664b6c0421e078 in this term.
I20260929 11:35:53.336995 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:53.337592 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:53.338117 15359 raft_consensus.cc:2379] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 2: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:53.338413 15433 raft_consensus.cc:2379] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 2b2ed85c4da64515a0664b6c0421e078 in this term.
I20260929 11:35:53.342154 15844 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.343225 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:53.343367 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:53.344040 15355 raft_consensus.cc:2379] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:53.300453 15896 raft_consensus.cc:504] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.346269 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:53.346711 15896 leader_election.cc:288] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.356230 15260 catalog_manager.cc:5495] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:53.363847 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:53.364847 15511 raft_consensus.cc:2379] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79f6b689389549ce8079ff46fd514467 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:53.366956 15885 raft_consensus.cc:482] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:53.367410 15885 raft_consensus.cc:504] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.375080 15876 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:53.382810 15901 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260929 11:35:53.388451 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:53.389268 15355 raft_consensus.cc:2379] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
W20260929 11:35:53.390601 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:53.378712 15512 raft_consensus.cc:2454] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:35:53.391330 15882 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260929 11:35:53.394059 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:53.382925 15876 consensus_queue.cc:1035] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260929 11:35:53.395814 15554 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:53.396224 15554 ts_tablet_manager.cc:1397] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.248s user 0.008s sys 0.009s
I20260929 11:35:53.396842 15885 leader_election.cc:288] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:53.399116 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:53.402138 15478 leader_election.cc:341] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:53.398530 15554 raft_consensus.cc:348] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.404175 15554 raft_consensus.cc:374] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.404516 15554 raft_consensus.cc:729] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:53.406726 15555 raft_consensus.cc:348] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.407429 15555 raft_consensus.cc:374] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.407656 15555 raft_consensus.cc:729] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:53.408215 15555 consensus_queue.cc:260] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.410152 15555 ts_tablet_manager.cc:1428] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.114s user 0.005s sys 0.000s
I20260929 11:35:53.411141 15555 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:53.413175 15554 consensus_queue.cc:260] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.414712 15554 ts_tablet_manager.cc:1428] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20260929 11:35:53.415616 15554 tablet_bootstrap.cc:492] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:53.417384 15553 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:53.417891 15553 ts_tablet_manager.cc:1397] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.262s user 0.016s sys 0.015s
I20260929 11:35:53.411171 15258 catalog_manager.cc:5495] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:53.435647 15476 leader_election.cc:302] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
W20260929 11:35:53.436190 15329 leader_election.cc:341] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:53.437618 15476 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:53.441594 15553 raft_consensus.cc:348] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.442111 15553 raft_consensus.cc:374] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.442344 15553 raft_consensus.cc:729] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
W20260929 11:35:53.444772 15329 consensus_peers.cc:487] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:53.449931 15898 raft_consensus.cc:2726] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:53.453038 15893 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:53.440126 15881 raft_consensus.cc:2726] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:35:53.444021 15553 consensus_queue.cc:260] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.434448 15844 consensus_queue.cc:1035] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260929 11:35:53.453683 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:53.418388 15404 leader_election.cc:302] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters: 79f6b689389549ce8079ff46fd514467
I20260929 11:35:53.469092 15360 raft_consensus.cc:2454] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
W20260929 11:35:53.469594 15404 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 51368.1us
I20260929 11:35:53.470889 15844 raft_consensus.cc:2781] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:53.471433 15844 raft_consensus.cc:686] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:53.472757 15844 consensus_queue.cc:237] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.475632 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:53.476487 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:53.478310 15555 tablet_bootstrap.cc:654] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:53.462852 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:53.476505 15510 raft_consensus.cc:2379] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:53.488215 15553 ts_tablet_manager.cc:1428] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.070s user 0.004s sys 0.003s
I20260929 11:35:53.491186 15434 raft_consensus.cc:2379] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79f6b689389549ce8079ff46fd514467 in current term 1: Already voted for candidate 2b2ed85c4da64515a0664b6c0421e078 in this term.
I20260929 11:35:53.490957 15553 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
W20260929 11:35:53.493673 15329 leader_election.cc:341] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:53.502477 15893 raft_consensus.cc:482] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:53.506942 15476 leader_election.cc:302] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:53.511961 15404 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.503120 15893 raft_consensus.cc:504] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.512764 15876 consensus_queue.cc:1035] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:53.521545 15329 leader_election.cc:302] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.519718 15792 raft_consensus.cc:2726] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:35:53.529006 15896 raft_consensus.cc:482] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:53.531280 15904 raft_consensus.cc:2781] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:53.537323 15904 raft_consensus.cc:482] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:53.537739 15904 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.531477 15872 raft_consensus.cc:482] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:53.531692 15888 raft_consensus.cc:2781] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:53.549922 15555 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:53.552245 15555 ts_tablet_manager.cc:1397] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.141s user 0.013s sys 0.003s
I20260929 11:35:53.539584 15896 raft_consensus.cc:504] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.552742 15888 raft_consensus.cc:482] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:53.558508 15888 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:53.539666 15402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 47244.5us
I20260929 11:35:53.560256 15896 leader_election.cc:288] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.561512 15554 tablet_bootstrap.cc:654] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:53.542562 15872 raft_consensus.cc:504] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.572424 15872 leader_election.cc:288] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
W20260929 11:35:53.586501 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 54784.8us
I20260929 11:35:53.587114 15555 raft_consensus.cc:348] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.588009 15555 raft_consensus.cc:374] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.588337 15555 raft_consensus.cc:729] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:53.590265 15893 leader_election.cc:288] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.591068 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:53.589476 15555 consensus_queue.cc:260] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.591740 15359 raft_consensus.cc:2454] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:53.583910 15916 consensus_queue.cc:1035] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260929 11:35:53.592470 15896 consensus_queue.cc:1035] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:53.600973 15553 tablet_bootstrap.cc:654] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:53.601377 15555 ts_tablet_manager.cc:1428] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.049s user 0.009s sys 0.002s
I20260929 11:35:53.602365 15555 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:53.602695 15744 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 11:35:53.609184 15329 leader_election.cc:341] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:53.613009 15478 consensus_peers.cc:487] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:53.614977 15476 leader_election.cc:302] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:53.616235 15744 raft_consensus.cc:2781] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:53.616094 15788 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:53.616677 15744 raft_consensus.cc:482] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:53.617041 15744 raft_consensus.cc:3037] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.609552 15329 leader_election.cc:302] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.624177 15329 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.626943 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:53.629833 15919 raft_consensus.cc:2726] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:35:53.626461 15804 raft_consensus.cc:2726] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:53.645491 15888 raft_consensus.cc:504] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.649286 15888 leader_election.cc:288] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.621856 15904 raft_consensus.cc:504] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.657289 15555 tablet_bootstrap.cc:654] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:53.657701 15478 leader_election.cc:341] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:53.662683 15554 tablet_bootstrap.cc:492] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:53.663511 15904 leader_election.cc:288] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:53.664252 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:53.665187 15554 ts_tablet_manager.cc:1397] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.250s user 0.023s sys 0.007s
I20260929 11:35:53.665037 15361 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.672786 15259 catalog_manager.cc:5495] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from adf4734bb02e4108b00fabc552483a18 (127.13.221.195) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:53.719135 15916 raft_consensus.cc:482] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:53.720716 15916 raft_consensus.cc:504] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.725122 15916 leader_election.cc:288] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.730165 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:53.731204 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:53.731253 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:53.732501 15554 raft_consensus.cc:348] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.733134 15554 raft_consensus.cc:374] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.733402 15554 raft_consensus.cc:729] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:53.703536 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:53.733991 15554 consensus_queue.cc:260] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.734207 15744 raft_consensus.cc:504] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.734642 15433 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.735541 15554 ts_tablet_manager.cc:1428] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.070s user 0.004s sys 0.000s
I20260929 11:35:53.736871 15553 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:53.737409 15553 ts_tablet_manager.cc:1397] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.247s user 0.009s sys 0.008s
I20260929 11:35:53.739745 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:53.741604 15506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:53.741861 15359 raft_consensus.cc:3037] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.729532 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d77475379646a99d34b739d3cfde14" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:53.745762 15506 raft_consensus.cc:2379] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:53.760812 15434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:53.761245 15506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:53.761509 15434 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.762624 15508 raft_consensus.cc:2396] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79f6b689389549ce8079ff46fd514467 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260929 11:35:53.765519 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:53.765652 15554 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
W20260929 11:35:53.767313 15478 leader_election.cc:341] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:53.770365 15329 leader_election.cc:341] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:53.771211 15329 leader_election.cc:302] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.756780 15744 leader_election.cc:288] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
W20260929 11:35:53.779542 15329 leader_election.cc:341] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:53.780202 15553 raft_consensus.cc:348] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.780845 15553 raft_consensus.cc:374] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.780999 15553 raft_consensus.cc:729] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:53.784473 15553 consensus_queue.cc:260] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.794088 15553 ts_tablet_manager.cc:1428] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.056s user 0.007s sys 0.000s
I20260929 11:35:53.795346 15553 tablet_bootstrap.cc:492] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:53.783039 15717 raft_consensus.cc:2726] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:35:53.769850 15402 leader_election.cc:302] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.805624 15513 raft_consensus.cc:3037] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:53.806305 15927 log.cc:924] Time spent T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
W20260929 11:35:53.808277 15402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 51832.7us
I20260929 11:35:53.811149 15744 consensus_queue.cc:1035] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260929 11:35:53.822136 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:53.843206 15434 raft_consensus.cc:2454] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
W20260929 11:35:53.861966 15329 leader_election.cc:341] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:53.862543 15329 leader_election.cc:302] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.833386 15433 raft_consensus.cc:2454] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:53.869292 15916 raft_consensus.cc:2726] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:53.865619 15804 raft_consensus.cc:2726] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:53.876914 15721 raft_consensus.cc:482] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:53.884545 15721 raft_consensus.cc:504] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.885951 15478 leader_election.cc:302] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:53.887814 15892 raft_consensus.cc:2781] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:53.888350 15892 raft_consensus.cc:686] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:53.889147 15892 consensus_queue.cc:237] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.890183 15555 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:53.890424 15359 raft_consensus.cc:2454] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:53.890641 15555 ts_tablet_manager.cc:1397] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.288s user 0.025s sys 0.012s
I20260929 11:35:53.895534 15555 raft_consensus.cc:348] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.896068 15555 raft_consensus.cc:374] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:53.896281 15555 raft_consensus.cc:729] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:53.886467 15721 leader_election.cc:288] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:53.898826 15555 consensus_queue.cc:260] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.900110 15476 leader_election.cc:302] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:53.903203 15553 tablet_bootstrap.cc:654] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:53.903774 15898 raft_consensus.cc:2781] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:53.902230 15505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd4efefe8d54575b3b5575a504bb0a1" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:53.904510 15898 raft_consensus.cc:686] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:53.905655 15554 tablet_bootstrap.cc:654] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:53.907162 15329 leader_election.cc:341] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:53.905355 15898 consensus_queue.cc:237] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:53.908380 15924 log.cc:924] Time spent T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18: Append to log took a long time: real 0.130s user 0.001s sys 0.000s
I20260929 11:35:53.913105 15555 ts_tablet_manager.cc:1428] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260929 11:35:53.896432 15361 raft_consensus.cc:2454] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:53.925086 15329 leader_election.cc:302] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.926354 15717 raft_consensus.cc:2781] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:53.926841 15717 raft_consensus.cc:686] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:53.927575 15717 consensus_queue.cc:237] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:53.935473 15555 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:53.965322 15359 raft_consensus.cc:1261] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:53.969115 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd4efefe8d54575b3b5575a504bb0a1" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:53.970156 15433 raft_consensus.cc:2454] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:53.973292 15553 tablet_bootstrap.cc:492] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:53.973811 15844 consensus_queue.cc:1035] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:53.976761 15329 leader_election.cc:302] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:53.977929 15553 ts_tablet_manager.cc:1397] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.183s user 0.012s sys 0.002s
I20260929 11:35:53.982203 15717 raft_consensus.cc:2781] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:53.982816 15717 raft_consensus.cc:482] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:53.983141 15717 raft_consensus.cc:3037] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:53.998193 15554 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:53.998695 15554 ts_tablet_manager.cc:1397] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.233s user 0.012s sys 0.012s
I20260929 11:35:54.009178 15555 tablet_bootstrap.cc:654] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.013669 15259 catalog_manager.cc:5495] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:54.013939 15258 catalog_manager.cc:5495] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:54.015412 15259 catalog_manager.cc:5495] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:54.025677 15717 raft_consensus.cc:504] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.026705 15553 raft_consensus.cc:348] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.027487 15553 raft_consensus.cc:374] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.027781 15553 raft_consensus.cc:729] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.027884 15717 leader_election.cc:288] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.028452 15553 consensus_queue.cc:260] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.033016 15553 ts_tablet_manager.cc:1428] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.055s user 0.008s sys 0.000s
I20260929 11:35:54.033986 15553 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:54.039387 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd4efefe8d54575b3b5575a504bb0a1" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:54.040076 15433 raft_consensus.cc:3037] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.041960 15554 raft_consensus.cc:348] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.042662 15554 raft_consensus.cc:374] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.042904 15554 raft_consensus.cc:729] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.032961 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd4efefe8d54575b3b5575a504bb0a1" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:54.043576 15554 consensus_queue.cc:260] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:54.044581 15329 leader_election.cc:341] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.046685 15554 ts_tablet_manager.cc:1428] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.048s user 0.009s sys 0.000s
I20260929 11:35:54.047739 15554 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:54.057991 15433 raft_consensus.cc:2454] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:54.061177 15329 leader_election.cc:302] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.062788 15804 raft_consensus.cc:2781] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:54.063341 15804 raft_consensus.cc:686] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:54.064162 15804 consensus_queue.cc:237] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.070444 15555 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:54.070468 15554 tablet_bootstrap.cc:654] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.070729 15553 tablet_bootstrap.cc:654] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.071071 15555 ts_tablet_manager.cc:1397] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.136s user 0.011s sys 0.002s
I20260929 11:35:54.074072 15555 raft_consensus.cc:348] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.074970 15555 raft_consensus.cc:374] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.075330 15555 raft_consensus.cc:729] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.076126 15555 consensus_queue.cc:260] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.129488 15555 ts_tablet_manager.cc:1428] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.058s user 0.008s sys 0.003s
I20260929 11:35:54.144289 15513 raft_consensus.cc:1261] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:35:54.145803 15555 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
W20260929 11:35:54.120265 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 54103.4us
I20260929 11:35:54.154235 15918 raft_consensus.cc:482] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.165097 15553 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:54.166265 15553 ts_tablet_manager.cc:1397] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.132s user 0.005s sys 0.012s
I20260929 11:35:54.155313 15918 raft_consensus.cc:504] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.177759 15432 raft_consensus.cc:3037] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.183848 15918 leader_election.cc:288] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.187927 15844 consensus_queue.cc:1035] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260929 11:35:54.205812 15554 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:54.206637 15554 ts_tablet_manager.cc:1397] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.159s user 0.009s sys 0.005s
I20260929 11:35:54.209113 15555 tablet_bootstrap.cc:654] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.211489 15553 raft_consensus.cc:348] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.212487 15553 raft_consensus.cc:374] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.212106 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb49a87a20fe49448ce6bec0ace3573f" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:54.212862 15553 raft_consensus.cc:729] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.213860 15553 consensus_queue.cc:260] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.216365 15553 ts_tablet_manager.cc:1428] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.050s user 0.010s sys 0.000s
I20260929 11:35:54.218078 15435 raft_consensus.cc:2454] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:54.217124 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb49a87a20fe49448ce6bec0ace3573f" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:54.216964 15554 raft_consensus.cc:348] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.225149 15554 raft_consensus.cc:374] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.227451 15554 raft_consensus.cc:729] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
W20260929 11:35:54.222718 15329 leader_election.cc:341] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.228260 15554 consensus_queue.cc:260] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.229723 15329 leader_election.cc:302] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.233851 15553 tablet_bootstrap.cc:492] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:54.234052 15717 raft_consensus.cc:2781] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:54.234440 15717 raft_consensus.cc:482] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:54.234805 15717 raft_consensus.cc:3037] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.258652 15896 raft_consensus.cc:482] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.260143 15262 catalog_manager.cc:5495] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:54.261348 15896 raft_consensus.cc:504] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.271103 15896 leader_election.cc:288] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.277840 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:54.293871 15553 tablet_bootstrap.cc:654] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.287513 15844 raft_consensus.cc:482] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
I20260929 11:35:54.295382 15844 raft_consensus.cc:504] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.296663 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:54.301335 15329 leader_election.cc:341] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:54.305743 15329 leader_election.cc:341] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.306416 15329 leader_election.cc:302] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.309378 15554 ts_tablet_manager.cc:1428] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.102s user 0.010s sys 0.002s
I20260929 11:35:54.312605 15919 raft_consensus.cc:2726] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:54.313051 15554 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:54.316766 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ab10cacb2684573bce3212170485cda" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:54.328764 15844 leader_election.cc:288] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.316504 15717 raft_consensus.cc:504] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.330312 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ab10cacb2684573bce3212170485cda" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:54.334920 15404 leader_election.cc:302] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.335260 15555 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:54.335862 15555 ts_tablet_manager.cc:1397] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.191s user 0.012s sys 0.014s
I20260929 11:35:54.336357 15844 raft_consensus.cc:2726] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:35:54.339975 15432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb49a87a20fe49448ce6bec0ace3573f" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:54.342463 15432 raft_consensus.cc:3037] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.344038 15555 raft_consensus.cc:348] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.347399 15555 raft_consensus.cc:374] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.350251 15555 raft_consensus.cc:729] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.351491 15432 raft_consensus.cc:2454] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:54.351053 15555 consensus_queue.cc:260] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.357504 15329 leader_election.cc:302] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:54.353032 15717 leader_election.cc:288] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.371907 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb49a87a20fe49448ce6bec0ace3573f" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:54.372641 15717 raft_consensus.cc:2781] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:54.361568 15554 tablet_bootstrap.cc:654] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.373649 15717 raft_consensus.cc:686] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:54.379467 15555 ts_tablet_manager.cc:1428] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.042s user 0.007s sys 0.002s
I20260929 11:35:54.383167 15706 consensus_queue.cc:1035] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:54.384426 15717 consensus_queue.cc:237] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.387663 15555 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
W20260929 11:35:54.396282 15329 leader_election.cc:341] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.407383 15554 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:54.408424 15554 ts_tablet_manager.cc:1397] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.096s user 0.014s sys 0.008s
I20260929 11:35:54.414959 15553 tablet_bootstrap.cc:492] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:54.415611 15553 ts_tablet_manager.cc:1397] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.182s user 0.028s sys 0.022s
I20260929 11:35:54.419534 15706 raft_consensus.cc:482] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.420086 15706 raft_consensus.cc:504] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.422819 15706 leader_election.cc:288] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:54.421715 15553 raft_consensus.cc:348] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.423296 15553 raft_consensus.cc:374] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.423571 15553 raft_consensus.cc:729] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.425491 15553 consensus_queue.cc:260] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.426846 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926107852c74f4aaf37989b571c292a" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:54.429190 15555 tablet_bootstrap.cc:654] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
W20260929 11:35:54.431473 15476 leader_election.cc:341] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.431520 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926107852c74f4aaf37989b571c292a" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:54.433529 15478 leader_election.cc:341] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.433964 15478 leader_election.cc:302] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:54.434859 15904 raft_consensus.cc:2726] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:54.437193 15706 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:54.437783 15553 ts_tablet_manager.cc:1428] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.022s user 0.003s sys 0.004s
I20260929 11:35:54.431048 15554 raft_consensus.cc:348] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.439335 15554 raft_consensus.cc:374] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.441519 15554 raft_consensus.cc:729] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.442173 15554 consensus_queue.cc:260] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:54.442524 15478 consensus_peers.cc:487] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:54.442225 15262 catalog_manager.cc:5495] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:54.444386 15554 ts_tablet_manager.cc:1428] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.035s user 0.004s sys 0.003s
I20260929 11:35:54.445329 15553 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
W20260929 11:35:54.452240 15329 consensus_peers.cc:487] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:54.466806 15554 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:54.480013 15904 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:54.489418 15717 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260929 11:35:54.498680 15506 raft_consensus.cc:3037] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.503185 15555 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:54.506683 15555 ts_tablet_manager.cc:1397] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.121s user 0.017s sys 0.013s
I20260929 11:35:54.515489 15553 tablet_bootstrap.cc:654] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.518980 15717 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:54.525903 15555 raft_consensus.cc:348] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.526680 15555 raft_consensus.cc:374] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.526969 15555 raft_consensus.cc:729] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.527629 15555 consensus_queue.cc:260] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:54.535041 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:54.545171 15555 ts_tablet_manager.cc:1428] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.036s user 0.003s sys 0.003s
I20260929 11:35:54.546193 15555 tablet_bootstrap.cc:492] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:54.550207 15896 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:54.551918 15555 tablet_bootstrap.cc:654] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.538612 15553 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:54.543223 15554 tablet_bootstrap.cc:654] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.558938 15553 ts_tablet_manager.cc:1397] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.114s user 0.008s sys 0.004s
I20260929 11:35:54.567752 15553 raft_consensus.cc:348] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.569350 15553 raft_consensus.cc:374] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.569593 15553 raft_consensus.cc:729] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.570047 15553 consensus_queue.cc:260] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.571491 15553 ts_tablet_manager.cc:1428] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260929 11:35:54.572304 15553 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:54.572600 15555 tablet_bootstrap.cc:492] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:54.576694 15555 ts_tablet_manager.cc:1397] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.009s
I20260929 11:35:54.580147 15717 raft_consensus.cc:482] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.580785 15717 raft_consensus.cc:504] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.582597 15717 leader_election.cc:288] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.584291 15432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ac378824b145ee99c987e4c3413ee9" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:54.579818 15554 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:54.586202 15554 ts_tablet_manager.cc:1397] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.129s user 0.007s sys 0.006s
I20260929 11:35:54.586637 15506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ac378824b145ee99c987e4c3413ee9" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:54.587077 15555 raft_consensus.cc:348] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:54.587793 15329 leader_election.cc:341] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.588066 15555 raft_consensus.cc:374] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.588374 15555 raft_consensus.cc:729] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.589180 15555 consensus_queue.cc:260] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:54.590758 15329 leader_election.cc:341] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.591172 15329 leader_election.cc:302] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.594858 15717 raft_consensus.cc:2726] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:54.590797 15554 raft_consensus.cc:348] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.596434 15554 raft_consensus.cc:374] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.597173 15554 raft_consensus.cc:729] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.597950 15555 ts_tablet_manager.cc:1428] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20260929 11:35:54.598991 15555 tablet_bootstrap.cc:492] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:54.600343 15554 consensus_queue.cc:260] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.604079 15554 ts_tablet_manager.cc:1428] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260929 11:35:54.604949 15555 tablet_bootstrap.cc:654] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.605506 15554 tablet_bootstrap.cc:492] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:54.624433 15553 tablet_bootstrap.cc:654] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.625201 15554 tablet_bootstrap.cc:654] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.624616 15555 tablet_bootstrap.cc:492] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:54.627976 15555 ts_tablet_manager.cc:1397] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.011s
I20260929 11:35:54.630954 15555 raft_consensus.cc:348] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.632442 15844 raft_consensus.cc:482] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.640002 15555 raft_consensus.cc:374] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.640165 15844 raft_consensus.cc:504] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.640938 15555 raft_consensus.cc:729] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.641855 15555 consensus_queue.cc:260] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.644889 15506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:54.645341 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:54.653321 15402 leader_election.cc:302] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.654212 15844 leader_election.cc:288] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.654353 15795 raft_consensus.cc:2726] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:54.655942 15904 raft_consensus.cc:482] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.656436 15904 raft_consensus.cc:504] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.658298 15555 ts_tablet_manager.cc:1428] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.030s user 0.008s sys 0.000s
I20260929 11:35:54.658421 15904 leader_election.cc:288] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:54.660192 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb49a87a20fe49448ce6bec0ace3573f" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:54.661010 15439 raft_consensus.cc:2379] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 79f6b689389549ce8079ff46fd514467 in this term.
I20260929 11:35:54.670217 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb49a87a20fe49448ce6bec0ace3573f" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:54.672825 15476 leader_election.cc:302] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:54.673817 15904 raft_consensus.cc:3037] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.674851 15555 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:54.683027 15904 raft_consensus.cc:2726] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:54.691702 15555 tablet_bootstrap.cc:654] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.694286 15554 tablet_bootstrap.cc:492] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:54.694422 15553 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:54.694720 15554 ts_tablet_manager.cc:1397] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.036s
I20260929 11:35:54.695657 15553 ts_tablet_manager.cc:1397] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.124s user 0.031s sys 0.020s
I20260929 11:35:54.698704 15554 raft_consensus.cc:348] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.699533 15554 raft_consensus.cc:374] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.699832 15554 raft_consensus.cc:729] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.700613 15554 consensus_queue.cc:260] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.701395 15555 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:54.701864 15555 ts_tablet_manager.cc:1397] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.027s user 0.013s sys 0.000s
I20260929 11:35:54.701589 15553 raft_consensus.cc:348] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.703122 15553 raft_consensus.cc:374] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.703426 15553 raft_consensus.cc:729] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.704309 15555 raft_consensus.cc:348] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.704938 15555 raft_consensus.cc:374] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.705207 15555 raft_consensus.cc:729] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.705817 15555 consensus_queue.cc:260] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.707657 15555 ts_tablet_manager.cc:1428] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260929 11:35:54.709465 15554 ts_tablet_manager.cc:1428] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.014s user 0.003s sys 0.002s
I20260929 11:35:54.710397 15554 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:54.704049 15553 consensus_queue.cc:260] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.715570 15554 tablet_bootstrap.cc:654] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.718075 15553 ts_tablet_manager.cc:1428] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.022s user 0.006s sys 0.001s
I20260929 11:35:54.718904 15555 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467: Bootstrap starting.
I20260929 11:35:54.719273 15553 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:54.726476 15555 tablet_bootstrap.cc:654] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.726815 15904 raft_consensus.cc:482] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.727301 15904 raft_consensus.cc:504] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.730046 15904 leader_election.cc:288] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:54.726460 15553 tablet_bootstrap.cc:654] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.731359 15554 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:54.731796 15554 ts_tablet_manager.cc:1397] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.003s
I20260929 11:35:54.733127 15896 raft_consensus.cc:482] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.733623 15896 raft_consensus.cc:504] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.734189 15554 raft_consensus.cc:348] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.734673 15555 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467: No bootstrap required, opened a new log
I20260929 11:35:54.734916 15554 raft_consensus.cc:374] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.735199 15554 raft_consensus.cc:729] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.735625 15555 ts_tablet_manager.cc:1397] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.005s
I20260929 11:35:54.735918 15554 consensus_queue.cc:260] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.737499 15432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "375c6bdafb5c46df89bbbb95795b6812" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:54.738335 15554 ts_tablet_manager.cc:1428] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20260929 11:35:54.738809 15506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "375c6bdafb5c46df89bbbb95795b6812" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
W20260929 11:35:54.739398 15329 leader_election.cc:341] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.739122 15555 raft_consensus.cc:348] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.740003 15555 raft_consensus.cc:374] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 11:35:54.740074 15329 leader_election.cc:341] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.740521 15555 raft_consensus.cc:729] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.740561 15329 leader_election.cc:302] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.741261 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:54.735690 15896 leader_election.cc:288] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.742386 15896 raft_consensus.cc:2726] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:54.740589 15554 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:54.741410 15555 consensus_queue.cc:260] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.745304 15555 ts_tablet_manager.cc:1428] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467: Time spent starting tablet: real 0.009s user 0.002s sys 0.005s
I20260929 11:35:54.735809 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:54.749570 15554 tablet_bootstrap.cc:654] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.750335 15478 leader_election.cc:302] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:54.752066 15898 raft_consensus.cc:2726] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:54.755770 15553 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:54.756287 15553 ts_tablet_manager.cc:1397] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.000s
I20260929 11:35:54.758236 15554 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:54.758771 15554 ts_tablet_manager.cc:1397] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.000s
I20260929 11:35:54.761332 15554 raft_consensus.cc:348] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.762111 15554 raft_consensus.cc:374] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.762428 15554 raft_consensus.cc:729] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.763078 15554 consensus_queue.cc:260] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.766566 15554 ts_tablet_manager.cc:1428] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260929 11:35:54.768530 15554 tablet_bootstrap.cc:492] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:54.774058 15554 tablet_bootstrap.cc:654] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.759357 15553 raft_consensus.cc:348] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.781111 15553 raft_consensus.cc:374] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.781441 15553 raft_consensus.cc:729] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.782203 15553 consensus_queue.cc:260] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.784964 15717 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:54.793776 15553 ts_tablet_manager.cc:1428] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.037s user 0.005s sys 0.001s
I20260929 11:35:54.794876 15553 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:54.800493 15717 raft_consensus.cc:482] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.800971 15717 raft_consensus.cc:504] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.802834 15717 leader_election.cc:288] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.804224 15553 tablet_bootstrap.cc:654] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.804637 15795 raft_consensus.cc:482] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.805111 15795 raft_consensus.cc:504] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.807363 15795 leader_election.cc:288] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.808929 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0c7572ce72494f9c505c54480619fa" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:54.809355 15553 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:54.809356 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0c7572ce72494f9c505c54480619fa" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:54.809631 15359 raft_consensus.cc:2454] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:54.810048 15553 ts_tablet_manager.cc:1397] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.001s
W20260929 11:35:54.810901 15404 leader_election.cc:341] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.811623 15402 leader_election.cc:302] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.812384 15795 raft_consensus.cc:2781] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:54.812723 15795 raft_consensus.cc:482] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:54.813024 15795 raft_consensus.cc:3037] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.813934 15554 tablet_bootstrap.cc:492] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:54.814393 15554 ts_tablet_manager.cc:1397] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.046s user 0.017s sys 0.021s
I20260929 11:35:54.815548 15506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926107852c74f4aaf37989b571c292a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:54.816493 15432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926107852c74f4aaf37989b571c292a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:54.816589 15506 raft_consensus.cc:2454] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:54.817404 15554 raft_consensus.cc:348] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.818095 15554 raft_consensus.cc:374] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.818356 15554 raft_consensus.cc:729] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.819145 15554 consensus_queue.cc:260] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.819155 15329 leader_election.cc:302] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:54.820739 15896 raft_consensus.cc:2781] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:54.821121 15896 raft_consensus.cc:482] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:54.821460 15896 raft_consensus.cc:3037] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.821571 15554 ts_tablet_manager.cc:1428] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260929 11:35:54.823115 15554 tablet_bootstrap.cc:492] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:54.823274 15916 raft_consensus.cc:482] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.823693 15916 raft_consensus.cc:504] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.824749 15717 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:54.825606 15916 leader_election.cc:288] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.828410 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a648c1e0b4665ae1e133d8f6fe219" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:54.829034 15356 raft_consensus.cc:2454] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:54.830600 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a648c1e0b4665ae1e133d8f6fe219" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:54.831328 15513 raft_consensus.cc:2454] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:54.831559 15402 leader_election.cc:302] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:54.833427 15844 raft_consensus.cc:2781] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:54.833791 15844 raft_consensus.cc:482] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:54.834182 15554 tablet_bootstrap.cc:654] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:54.834142 15844 raft_consensus.cc:3037] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.840447 15553 raft_consensus.cc:348] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.842221 15553 raft_consensus.cc:374] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:54.843214 15553 raft_consensus.cc:729] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:54.843945 15553 consensus_queue.cc:260] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.852308 15717 raft_consensus.cc:482] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.852995 15717 raft_consensus.cc:504] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.857364 15717 leader_election.cc:288] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.859764 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37a9bc249c74356a37d92fe9124c7cc" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:35:54.861388 15329 leader_election.cc:341] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.861778 15433 raft_consensus.cc:3037] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.863128 15896 raft_consensus.cc:504] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.864450 15795 raft_consensus.cc:504] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.865309 15432 raft_consensus.cc:2454] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 0.
I20260929 11:35:54.866577 15795 leader_election.cc:288] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.867805 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0c7572ce72494f9c505c54480619fa" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:54.868641 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37a9bc249c74356a37d92fe9124c7cc" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:54.869350 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0c7572ce72494f9c505c54480619fa" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:54.869920 15359 raft_consensus.cc:3037] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:54.871260 15404 leader_election.cc:341] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.867143 15896 leader_election.cc:288] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
W20260929 11:35:54.874718 15329 leader_election.cc:341] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:54.875126 15329 leader_election.cc:302] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.876070 15432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926107852c74f4aaf37989b571c292a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:54.876694 15432 raft_consensus.cc:3037] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.878238 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926107852c74f4aaf37989b571c292a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:54.879269 15896 raft_consensus.cc:2726] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:54.878849 15511 raft_consensus.cc:3037] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.884402 15553 ts_tablet_manager.cc:1428] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.074s user 0.008s sys 0.009s
I20260929 11:35:54.914930 15553 tablet_bootstrap.cc:492] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:54.915419 15872 raft_consensus.cc:482] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:54.915894 15872 raft_consensus.cc:504] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.922195 15872 leader_election.cc:288] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:54.924386 15432 raft_consensus.cc:2454] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:54.927505 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:54.928442 15361 raft_consensus.cc:2454] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:54.930583 15476 leader_election.cc:302] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:54.931180 15359 raft_consensus.cc:2454] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:54.932420 15402 leader_election.cc:302] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters: adf4734bb02e4108b00fabc552483a18
I20260929 11:35:54.933558 15904 raft_consensus.cc:2781] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:54.933966 15904 raft_consensus.cc:482] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:54.934309 15904 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:54.935746 15511 raft_consensus.cc:2454] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:35:54.936501 15916 raft_consensus.cc:2781] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
W20260929 11:35:54.938241 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 62230.3us
I20260929 11:35:54.867806 15844 raft_consensus.cc:504] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:54.965310 15329 leader_election.cc:302] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:54.981566 15976 raft_consensus.cc:2781] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:54.979341 15844 leader_election.cc:288] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:54.985857 15916 raft_consensus.cc:686] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:55.061124 15506 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.056294 15904 raft_consensus.cc:504] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.041055 15916 consensus_queue.cc:237] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.075827 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a648c1e0b4665ae1e133d8f6fe219" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:55.093400 15976 raft_consensus.cc:686] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:35:55.094368 15976 consensus_queue.cc:237] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.098213 15554 tablet_bootstrap.cc:492] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:55.098654 15554 ts_tablet_manager.cc:1397] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.276s user 0.009s sys 0.006s
I20260929 11:35:55.107050 15904 leader_election.cc:288] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:55.100013 15511 raft_consensus.cc:3037] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.100484 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a648c1e0b4665ae1e133d8f6fe219" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:55.121157 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:55.121869 15360 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.119309 15356 raft_consensus.cc:3037] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.142632 15844 raft_consensus.cc:482] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:55.143215 15844 raft_consensus.cc:504] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.145272 15844 leader_election.cc:288] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:55.146828 15553 tablet_bootstrap.cc:654] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.148226 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ac378824b145ee99c987e4c3413ee9" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:55.161005 15361 raft_consensus.cc:2454] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:55.161541 15981 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:55.149745 15432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:55.162035 15981 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.162725 15402 leader_election.cc:302] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:55.165032 15795 raft_consensus.cc:2781] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:55.165452 15795 raft_consensus.cc:482] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:55.165788 15795 raft_consensus.cc:3037] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.165681 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ac378824b145ee99c987e4c3413ee9" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:55.167694 15981 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:55.168644 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:55.168790 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:55.169356 15509 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:55.169689 15361 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:55.170562 15404 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:55.171684 15981 raft_consensus.cc:2781] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:35:55.172029 15981 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260929 11:35:55.172155 15476 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 52261.3us
I20260929 11:35:55.172513 15981 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:35:55.176276 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 69601.3us
I20260929 11:35:55.166371 15510 raft_consensus.cc:2454] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:55.179517 15356 raft_consensus.cc:2454] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:55.180477 15511 raft_consensus.cc:2454] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
W20260929 11:35:55.179492 15478 leader_election.cc:341] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:55.181694 15404 leader_election.cc:302] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:55.182690 15844 raft_consensus.cc:2781] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:55.183189 15844 raft_consensus.cc:686] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:55.184046 15844 consensus_queue.cc:237] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.184689 15795 raft_consensus.cc:504] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.187479 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ac378824b145ee99c987e4c3413ee9" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:55.188130 15356 raft_consensus.cc:3037] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.190810 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:55.192107 15795 leader_election.cc:288] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:55.192773 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ac378824b145ee99c987e4c3413ee9" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:55.193394 15509 raft_consensus.cc:3037] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.202713 15360 raft_consensus.cc:2454] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
W20260929 11:35:55.242863 15478 leader_election.cc:341] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:55.260154 15509 raft_consensus.cc:2454] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:55.247035 15356 raft_consensus.cc:2454] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:55.267778 15898 raft_consensus.cc:482] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:55.323027 15554 raft_consensus.cc:348] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.323819 15554 raft_consensus.cc:374] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.324146 15554 raft_consensus.cc:729] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.324752 15554 consensus_queue.cc:260] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:55.331758 15993 log.cc:924] Time spent T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20260929 11:35:55.331514 15404 leader_election.cc:302] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:55.338881 15554 ts_tablet_manager.cc:1428] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.240s user 0.005s sys 0.010s
I20260929 11:35:55.319725 15898 raft_consensus.cc:504] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:55.352531 15476 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 109862us
I20260929 11:35:55.353842 15476 leader_election.cc:302] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:55.345933 15844 raft_consensus.cc:2781] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:55.364557 15982 raft_consensus.cc:2781] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:55.369688 15553 tablet_bootstrap.cc:492] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:55.370281 15553 ts_tablet_manager.cc:1397] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.484s user 0.014s sys 0.033s
I20260929 11:35:55.363610 15844 raft_consensus.cc:686] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:55.368742 15982 raft_consensus.cc:686] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:55.385251 15982 consensus_queue.cc:237] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.388197 15844 consensus_queue.cc:237] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.397588 15898 leader_election.cc:288] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:55.398310 15511 raft_consensus.cc:3037] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.404870 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:55.405664 15553 raft_consensus.cc:348] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.406383 15553 raft_consensus.cc:374] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.406630 15553 raft_consensus.cc:729] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.407203 15553 consensus_queue.cc:260] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.415691 15554 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:55.422052 15981 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.430562 15554 tablet_bootstrap.cc:654] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.453529 15553 ts_tablet_manager.cc:1428] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.083s user 0.006s sys 0.000s
I20260929 11:35:55.451784 15916 raft_consensus.cc:482] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:55.452839 15981 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:55.461683 15916 raft_consensus.cc:504] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.464754 15916 leader_election.cc:288] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:55.457338 15553 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:55.478322 15258 catalog_manager.cc:5495] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:55.506062 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:55.508375 15553 tablet_bootstrap.cc:654] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.540635 16008 raft_consensus.cc:482] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:55.540802 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:55.541468 15509 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:55.541198 16008 raft_consensus.cc:504] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.542057 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:55.543563 16008 leader_election.cc:288] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:55.544405 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:55.544991 15364 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:35:55.549185 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:55.556447 15509 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:35:55.550745 15355 raft_consensus.cc:2454] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:55.563023 15431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "375c6bdafb5c46df89bbbb95795b6812" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:55.564733 15402 leader_election.cc:302] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:55.565549 15844 raft_consensus.cc:2781] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:55.565919 15844 raft_consensus.cc:482] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:55.566238 15844 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:55.570565 15478 leader_election.cc:341] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:55.574613 15476 leader_election.cc:302] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:55.576143 15982 raft_consensus.cc:2726] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:55.576076 15844 raft_consensus.cc:504] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.579999 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "375c6bdafb5c46df89bbbb95795b6812" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:55.579041 15844 leader_election.cc:288] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:55.580765 15362 raft_consensus.cc:2454] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:55.585860 15476 leader_election.cc:302] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:55.589768 15706 raft_consensus.cc:2781] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:55.590116 15706 raft_consensus.cc:482] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:55.590442 15706 raft_consensus.cc:3037] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.593448 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:55.594080 15361 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.595101 15364 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:35:55.602298 15975 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:55.606559 15554 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
W20260929 11:35:55.606897 15310 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:35:55.607152 15554 ts_tablet_manager.cc:1397] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.192s user 0.019s sys 0.015s
I20260929 11:35:55.610594 15402 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:55.613232 15844 raft_consensus.cc:2781] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:35:55.613736 15844 raft_consensus.cc:686] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:55.615008 15706 raft_consensus.cc:504] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.617125 15844 consensus_queue.cc:237] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.620275 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "375c6bdafb5c46df89bbbb95795b6812" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:55.617117 15706 leader_election.cc:288] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:55.621285 15554 raft_consensus.cc:348] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.622120 15554 raft_consensus.cc:374] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.622457 15554 raft_consensus.cc:729] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.623844 15554 consensus_queue.cc:260] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.628824 15554 ts_tablet_manager.cc:1428] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20260929 11:35:55.628623 15975 consensus_queue.cc:1035] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:55.629966 15554 tablet_bootstrap.cc:492] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:55.636162 15553 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:55.636771 15553 ts_tablet_manager.cc:1397] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.180s user 0.023s sys 0.033s
I20260929 11:35:55.653939 16007 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:55.654871 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "375c6bdafb5c46df89bbbb95795b6812" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:55.655504 15364 raft_consensus.cc:3037] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:35:55.656253 15478 leader_election.cc:341] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:35:55.659726 15404 leader_election.cc:341] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:55.664875 15554 tablet_bootstrap.cc:654] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.659011 15361 raft_consensus.cc:2454] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:55.668565 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:55.668651 15553 raft_consensus.cc:348] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.684341 15553 raft_consensus.cc:374] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.684681 15553 raft_consensus.cc:729] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.686013 15553 consensus_queue.cc:260] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.689067 15553 ts_tablet_manager.cc:1428] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.052s user 0.007s sys 0.000s
I20260929 11:35:55.689975 15553 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:55.690682 15896 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:55.669914 15402 leader_election.cc:302] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:35:55.693532 15844 raft_consensus.cc:2781] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:55.693939 15844 raft_consensus.cc:686] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
W20260929 11:35:55.695547 15404 leader_election.cc:341] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:35:55.692706 15364 raft_consensus.cc:2454] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:55.694553 15844 consensus_queue.cc:237] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.701062 15476 leader_election.cc:302] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:35:55.701998 15706 raft_consensus.cc:2781] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:55.702391 15706 raft_consensus.cc:686] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:55.702931 15706 consensus_queue.cc:237] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:35:55.716583 15404 consensus_peers.cc:487] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:55.717340 15975 raft_consensus.cc:482] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:55.746393 15981 consensus_queue.cc:1035] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:55.744143 15553 tablet_bootstrap.cc:654] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.726848 15975 raft_consensus.cc:504] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.749995 15975 leader_election.cc:288] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:55.752986 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:55.754141 15361 raft_consensus.cc:2379] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:55.757498 15511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:55.766788 15404 leader_election.cc:302] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:55.769263 15981 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.792672 15980 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:55.793373 15981 raft_consensus.cc:2726] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:55.812861 15553 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:55.812290 15259 catalog_manager.cc:5495] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:55.813805 15553 ts_tablet_manager.cc:1397] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.124s user 0.021s sys 0.000s
I20260929 11:35:55.824342 16008 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:35:55.827368 15553 raft_consensus.cc:348] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.828351 15553 raft_consensus.cc:374] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.828792 15553 raft_consensus.cc:729] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.829380 15553 consensus_queue.cc:260] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.817099 15554 tablet_bootstrap.cc:492] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:55.830432 15554 ts_tablet_manager.cc:1397] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.201s user 0.016s sys 0.006s
I20260929 11:35:55.831581 15553 ts_tablet_manager.cc:1428] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260929 11:35:55.832530 15553 tablet_bootstrap.cc:492] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:55.836253 15262 catalog_manager.cc:5495] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:55.837772 15553 tablet_bootstrap.cc:654] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.846690 15553 tablet_bootstrap.cc:492] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:55.847129 15553 ts_tablet_manager.cc:1397] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.002s
I20260929 11:35:55.849334 15553 raft_consensus.cc:348] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.849970 15553 raft_consensus.cc:374] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.850276 15553 raft_consensus.cc:729] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.850857 15553 consensus_queue.cc:260] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.852844 15553 ts_tablet_manager.cc:1428] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260929 11:35:55.853708 15553 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: Bootstrap starting.
I20260929 11:35:55.860729 15553 tablet_bootstrap.cc:654] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.867274 15554 raft_consensus.cc:348] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.868027 15554 raft_consensus.cc:374] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.868309 15554 raft_consensus.cc:729] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.869009 15981 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:55.869525 15554 consensus_queue.cc:260] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.870715 15258 catalog_manager.cc:5495] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:55.872134 15554 ts_tablet_manager.cc:1428] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.041s user 0.006s sys 0.000s
I20260929 11:35:55.873345 15554 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:55.876734 15553 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: No bootstrap required, opened a new log
I20260929 11:35:55.877168 15553 ts_tablet_manager.cc:1397] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.010s
I20260929 11:35:55.873216 15258 catalog_manager.cc:5495] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:55.879532 15553 raft_consensus.cc:348] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.880194 15553 raft_consensus.cc:374] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.880460 15553 raft_consensus.cc:729] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.881197 15553 consensus_queue.cc:260] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.879364 15258 catalog_manager.cc:5495] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:55.883428 15553 ts_tablet_manager.cc:1428] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260929 11:35:55.883378 15258 catalog_manager.cc:5495] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:55.888271 15554 tablet_bootstrap.cc:654] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.893389 15554 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:55.893815 15554 ts_tablet_manager.cc:1397] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.001s
I20260929 11:35:55.894093 15975 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:55.898305 15554 raft_consensus.cc:348] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.899012 15554 raft_consensus.cc:374] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.902195 15554 raft_consensus.cc:729] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.902892 15554 consensus_queue.cc:260] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.911830 15554 ts_tablet_manager.cc:1428] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260929 11:35:55.913343 15554 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18: Bootstrap starting.
I20260929 11:35:55.919031 15554 tablet_bootstrap.cc:654] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18: Neither blocks nor log segments found. Creating new log.
I20260929 11:35:55.918841 15262 catalog_manager.cc:5495] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:55.930696 15554 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18: No bootstrap required, opened a new log
I20260929 11:35:55.931121 15554 ts_tablet_manager.cc:1397] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.000s
I20260929 11:35:55.933697 15554 raft_consensus.cc:348] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.934505 15554 raft_consensus.cc:374] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:35:55.934764 15554 raft_consensus.cc:729] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Initialized, Role: FOLLOWER
I20260929 11:35:55.935388 15554 consensus_queue.cc:260] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.937299 15554 ts_tablet_manager.cc:1428] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260929 11:35:55.938349 16008 raft_consensus.cc:482] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:55.938825 16008 raft_consensus.cc:504] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:55.940524 16008 leader_election.cc:288] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:55.941170 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:55.941951 15356 raft_consensus.cc:2379] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adf4734bb02e4108b00fabc552483a18 in current term 1: Already voted for candidate 2b2ed85c4da64515a0664b6c0421e078 in this term.
I20260929 11:35:55.942703 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:55.944130 15478 leader_election.cc:302] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adf4734bb02e4108b00fabc552483a18; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:35:55.945189 16008 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:55.951251 16008 raft_consensus.cc:2726] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:56.052488 15898 raft_consensus.cc:482] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:56.052944 15898 raft_consensus.cc:504] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:56.055200 15898 leader_election.cc:288] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:56.055612 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37a9bc249c74356a37d92fe9124c7cc" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:56.055955 15439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37a9bc249c74356a37d92fe9124c7cc" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:35:56.056571 15439 raft_consensus.cc:2454] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:56.056397 15356 raft_consensus.cc:2454] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 0.
I20260929 11:35:56.057868 15476 leader_election.cc:302] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:56.058615 15898 raft_consensus.cc:2781] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:56.059221 15916 raft_consensus.cc:482] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:56.058964 15898 raft_consensus.cc:482] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:56.059705 15916 raft_consensus.cc:504] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:56.060205 15898 raft_consensus.cc:3037] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:56.062834 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:56.063426 15509 raft_consensus.cc:2454] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:56.064566 15404 leader_election.cc:302] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:56.064829 15916 leader_election.cc:288] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:56.065354 15975 raft_consensus.cc:2781] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:35:56.065691 15975 raft_consensus.cc:482] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:35:56.065996 15975 raft_consensus.cc:3037] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:56.067050 15898 raft_consensus.cc:504] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:56.069875 15898 leader_election.cc:288] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:56.070375 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37a9bc249c74356a37d92fe9124c7cc" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:35:56.071014 15438 raft_consensus.cc:3037] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:56.071296 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:56.071897 15364 raft_consensus.cc:2454] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 0.
I20260929 11:35:56.075443 15509 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260929 11:35:56.077561 15844 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.078274 15438 raft_consensus.cc:2454] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:56.079526 15478 leader_election.cc:302] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:56.080924 15982 raft_consensus.cc:2781] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:56.081372 15982 raft_consensus.cc:686] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:35:56.082130 15982 consensus_queue.cc:237] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:56.084586 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e37a9bc249c74356a37d92fe9124c7cc" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:56.085207 15356 raft_consensus.cc:3037] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:56.087970 15975 raft_consensus.cc:504] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:56.090292 15364 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260929 11:35:56.090626 15975 leader_election.cc:288] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:56.090514 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:35:56.091209 15355 raft_consensus.cc:3037] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:56.094575 15356 raft_consensus.cc:2454] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:35:56.097680 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:35:56.098483 15513 raft_consensus.cc:3037] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:56.100149 15975 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.105471 15513 raft_consensus.cc:2454] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:56.107170 15404 leader_election.cc:302] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:35:56.108376 15844 raft_consensus.cc:2781] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:35:56.108798 15844 raft_consensus.cc:686] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:35:56.109253 15355 raft_consensus.cc:2454] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 1.
I20260929 11:35:56.109549 15844 consensus_queue.cc:237] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:56.109438 15262 catalog_manager.cc:5495] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:35:56.132704 15262 catalog_manager.cc:5495] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:56.175215 15975 raft_consensus.cc:482] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:35:56.175725 15975 raft_consensus.cc:504] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:35:56.178176 15975 leader_election.cc:288] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:56.178548 15513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "375c6bdafb5c46df89bbbb95795b6812" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:35:56.178448 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "375c6bdafb5c46df89bbbb95795b6812" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:35:56.179232 15356 raft_consensus.cc:2379] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2ed85c4da64515a0664b6c0421e078 in current term 1: Already voted for candidate adf4734bb02e4108b00fabc552483a18 in this term.
I20260929 11:35:56.180318 15404 leader_election.cc:302] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:35:56.181056 15916 raft_consensus.cc:3037] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:56.185673 15916 raft_consensus.cc:2726] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:35:56.193887 15916 consensus_queue.cc:1035] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.207765 15981 consensus_queue.cc:1035] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.211652 15898 consensus_queue.cc:1035] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.231235 15982 consensus_queue.cc:1035] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.238466 15509 raft_consensus.cc:3037] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:35:56.489423 15982 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.498056 15982 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.590973 15981 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:56.600926 15981 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:35:57.692377 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:35:57.701546 16051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:57.718585 16052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:35:57.721845 16054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:35:57.722031 14199 server_base.cc:1034] running on GCE node
I20260929 11:35:57.723742 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:35:57.724048 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:35:57.724290 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681757724272 us; error 0 us; skew 500 ppm
I20260929 11:35:57.725073 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:35:57.728798 14199 webserver.cc:460] Webserver started at http://127.13.221.196:44135/ using document root <none> and password file <none>
I20260929 11:35:57.729457 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:35:57.729738 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:35:57.730118 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:35:57.731715 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-3-root/instance:
uuid: "bf69c081fbc04bb398d116939cc78f21"
format_stamp: "Formatted at 2026-09-29 11:35:57 on dist-test-slave-szp1"
I20260929 11:35:57.742628 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.001s sys 0.004s
I20260929 11:35:57.748137 16059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:57.749333 14199 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260929 11:35:57.749610 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-3-root
uuid: "bf69c081fbc04bb398d116939cc78f21"
format_stamp: "Formatted at 2026-09-29 11:35:57 on dist-test-slave-szp1"
I20260929 11:35:57.749851 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:35:57.789428 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:35:57.791244 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:35:57.792846 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:35:57.795346 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:35:57.795579 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:57.795873 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:35:57.796061 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:35:57.843354 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.196:39689
I20260929 11:35:57.843462 16121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.196:39689 every 8 connection(s)
I20260929 11:35:57.862018 14199 auto_leader_rebalancer-test.cc:413] add a tserver: bf69c081fbc04bb398d116939cc78f21
I20260929 11:35:57.899883 16122 heartbeater.cc:347] Connected to a master server at 127.13.221.254:38577
I20260929 11:35:57.900388 16122 heartbeater.cc:464] Registering TS with master...
I20260929 11:35:57.901208 16122 heartbeater.cc:511] Master 127.13.221.254:38577 requested a full tablet report, sending...
I20260929 11:35:57.902932 15260 ts_manager.cc:194] Registered new tserver with Master: bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:35:57.904484 15260 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33970
I20260929 11:35:58.829972 15438 consensus_queue.cc:237] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:58.835655 15509 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:35:58.836130 15364 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:35:58.837881 15975 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:35:58.839917 16131 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:58.848630 15975 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:58.850081 15356 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:58.852864 15509 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:35:58.856102 15405 consensus_peers.cc:487] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86dbbec4ace04094a09c85a3ad15d9fb. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:58.869553 15260 catalog_manager.cc:5495] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:58.887717 15356 consensus_queue.cc:237] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:58.895967 15511 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:35:58.897877 15438 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:35:58.899433 16050 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:58.907068 16122 heartbeater.cc:503] Master 127.13.221.254:38577 was elected leader, sending a full tablet report...
I20260929 11:35:58.908056 16127 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260929 11:35:58.923672 15330 consensus_peers.cc:487] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7c9ca97877f48c9ba1c6a3503576624. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:58.926306 16050 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:58.938158 15438 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:58.944841 15509 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:58.947573 15262 catalog_manager.cc:5495] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:35:58.968190 15509 consensus_queue.cc:237] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:58.976100 15438 raft_consensus.cc:1261] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:35:58.977746 15982 consensus_queue.cc:1035] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:58.982191 15356 raft_consensus.cc:1261] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:35:58.983824 15898 consensus_queue.cc:1035] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260929 11:35:59.010159 15479 consensus_peers.cc:487] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9bdacdc58094518aa9198105dee0e0b. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:59.012650 15982 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:59.014885 15438 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:59.015672 15356 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:59.033855 15355 consensus_queue.cc:237] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.052390 15258 catalog_manager.cc:5495] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:35:59.094089 15476 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 67430.6us
W20260929 11:35:59.097623 15330 consensus_peers.cc:487] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 133f7cd27af34f7ebc89e90b65170522. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:35:59.099409 15438 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:35:59.102212 15511 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:35:59.103112 16145 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:59.105922 16145 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:35:59.118566 16127 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:59.120601 15438 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:59.120589 15511 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:59.134850 15260 catalog_manager.cc:5495] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:35:59.238965 16157 ts_tablet_manager.cc:927] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:35:59.243635 16157 tablet_copy_client.cc:316] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:35:59.269893 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 86dbbec4ace04094a09c85a3ad15d9fb from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:35:59.270586 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 86dbbec4ace04094a09c85a3ad15d9fb from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-86dbbec4ace04094a09c85a3ad15d9fb
I20260929 11:35:59.278035 15449 tablet_copy_source_session.cc:205] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:35:59.282948 16157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86dbbec4ace04094a09c85a3ad15d9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:59.301069 16157 tablet_copy_client.cc:791] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:35:59.302435 16157 tablet_copy_client.cc:655] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:35:59.309295 16157 tablet_copy_client.cc:531] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:35:59.321360 16157 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:35:59.344148 16157 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:35:59.345191 16157 tablet_bootstrap.cc:492] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:35:59.345809 16157 ts_tablet_manager.cc:1397] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.008s
I20260929 11:35:59.348439 16157 raft_consensus.cc:348] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.349290 16157 raft_consensus.cc:729] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:35:59.349921 16157 consensus_queue.cc:260] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.353583 16157 ts_tablet_manager.cc:1428] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260929 11:35:59.355748 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-86dbbec4ace04094a09c85a3ad15d9fb received from {username='slave'} at 127.0.0.1:36114
I20260929 11:35:59.356165 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-86dbbec4ace04094a09c85a3ad15d9fb on tablet 86dbbec4ace04094a09c85a3ad15d9fb with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:35:59.470336 16157 ts_tablet_manager.cc:927] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:35:59.471966 16157 tablet_copy_client.cc:316] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:35:59.484157 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet c7c9ca97877f48c9ba1c6a3503576624 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:35:59.484728 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet c7c9ca97877f48c9ba1c6a3503576624 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-c7c9ca97877f48c9ba1c6a3503576624
I20260929 11:35:59.491906 15374 tablet_copy_source_session.cc:205] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:35:59.495359 16157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c9ca97877f48c9ba1c6a3503576624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:59.509367 16157 tablet_copy_client.cc:791] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:35:59.509927 16157 tablet_copy_client.cc:655] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:35:59.514636 16157 tablet_copy_client.cc:531] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:35:59.521751 16157 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:35:59.561789 16164 ts_tablet_manager.cc:927] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:35:59.564967 16164 tablet_copy_client.cc:316] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:35:59.570372 16157 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:35:59.571342 16157 tablet_bootstrap.cc:492] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:35:59.571976 16157 ts_tablet_manager.cc:1397] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.050s user 0.014s sys 0.026s
I20260929 11:35:59.574555 16157 raft_consensus.cc:348] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.575326 16157 raft_consensus.cc:729] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:35:59.575934 16157 consensus_queue.cc:260] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.578173 16157 ts_tablet_manager.cc:1428] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260929 11:35:59.579821 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-c7c9ca97877f48c9ba1c6a3503576624 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:35:59.580219 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-c7c9ca97877f48c9ba1c6a3503576624 on tablet c7c9ca97877f48c9ba1c6a3503576624 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:35:59.591992 15523 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet e9bdacdc58094518aa9198105dee0e0b from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:35:59.592658 15523 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet e9bdacdc58094518aa9198105dee0e0b from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-e9bdacdc58094518aa9198105dee0e0b
I20260929 11:35:59.599092 15523 tablet_copy_source_session.cc:205] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:35:59.602166 16164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9bdacdc58094518aa9198105dee0e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:59.615489 16164 tablet_copy_client.cc:791] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:35:59.616955 16164 tablet_copy_client.cc:655] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:35:59.622043 16164 tablet_copy_client.cc:531] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:35:59.629988 16097 raft_consensus.cc:1203] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:35:59.643822 16164 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:35:59.661445 16164 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:35:59.662345 16164 tablet_bootstrap.cc:492] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:35:59.662946 16164 ts_tablet_manager.cc:1397] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.004s
I20260929 11:35:59.665308 16164 raft_consensus.cc:348] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.666133 16164 raft_consensus.cc:729] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:35:59.666739 16164 consensus_queue.cc:260] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.669332 16164 ts_tablet_manager.cc:1428] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260929 11:35:59.673084 15523 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-e9bdacdc58094518aa9198105dee0e0b received from {username='slave'} at 127.0.0.1:55836
I20260929 11:35:59.673473 15523 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-e9bdacdc58094518aa9198105dee0e0b on tablet e9bdacdc58094518aa9198105dee0e0b with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:35:59.689672 16164 ts_tablet_manager.cc:927] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:35:59.691182 16164 tablet_copy_client.cc:316] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:35:59.692564 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 133f7cd27af34f7ebc89e90b65170522 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:35:59.693074 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 133f7cd27af34f7ebc89e90b65170522 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-133f7cd27af34f7ebc89e90b65170522
I20260929 11:35:59.701938 15374 tablet_copy_source_session.cc:205] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:35:59.704604 16164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133f7cd27af34f7ebc89e90b65170522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:35:59.718436 16164 tablet_copy_client.cc:791] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:35:59.719015 16164 tablet_copy_client.cc:655] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:35:59.722313 16164 tablet_copy_client.cc:531] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:35:59.731263 16164 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:35:59.748193 16164 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:35:59.750603 16164 tablet_bootstrap.cc:492] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:35:59.751359 16164 ts_tablet_manager.cc:1397] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.006s
I20260929 11:35:59.754113 16164 raft_consensus.cc:348] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.754959 16164 raft_consensus.cc:729] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:35:59.755558 16164 consensus_queue.cc:260] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:35:59.758333 16164 ts_tablet_manager.cc:1428] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260929 11:35:59.759748 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-133f7cd27af34f7ebc89e90b65170522 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:35:59.760147 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-133f7cd27af34f7ebc89e90b65170522 on tablet 133f7cd27af34f7ebc89e90b65170522 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:00.001078 16097 raft_consensus.cc:1203] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:00.050611 16097 raft_consensus.cc:1203] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:00.089366 15981 raft_consensus.cc:1050] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:00.091372 15981 consensus_queue.cc:237] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:00.100560 16097 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.101756 15355 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.102304 15509 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.103081 15975 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260929 11:36:00.106799 16131 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:00.108840 15981 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:00.134629 15975 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.136250 16097 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.138346 15356 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.147998 15509 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.160511 15258 catalog_manager.cc:5495] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:00.198426 15439 consensus_queue.cc:237] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:00.203401 16097 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:00.203797 15509 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:00.204982 15975 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:00.205729 16131 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:00.212960 15975 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.214843 16097 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.222162 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 86dbbec4ace04094a09c85a3ad15d9fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:00.222555 15511 raft_consensus.cc:2932] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.233271 15262 catalog_manager.cc:5495] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:00.260169 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 86dbbec4ace04094a09c85a3ad15d9fb with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:00.262467 16181 tablet_replica.cc:330] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:00.263306 16181 raft_consensus.cc:2229] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:00.263943 16181 raft_consensus.cc:2258] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:00.276244 16097 raft_consensus.cc:1203] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:00.294880 16181 ts_tablet_manager.cc:1905] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:00.321336 16181 ts_tablet_manager.cc:1918] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:00.321794 16181 log.cc:1196] T 86dbbec4ace04094a09c85a3ad15d9fb P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/86dbbec4ace04094a09c85a3ad15d9fb
I20260929 11:36:00.323235 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 86dbbec4ace04094a09c85a3ad15d9fb (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:00.570328 16172 raft_consensus.cc:1050] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:00.572504 16172 consensus_queue.cc:237] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:00.580392 16097 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.581843 16146 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:00.582654 15438 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.584897 15509 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.590857 16146 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:00.593007 16145 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:00.612346 16146 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.621152 15511 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.627573 16097 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.628845 15439 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.637915 15898 raft_consensus.cc:1050] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:00.640209 15898 consensus_queue.cc:237] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:00.644455 15262 catalog_manager.cc:5495] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:00.665213 16096 raft_consensus.cc:1261] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.667791 16187 consensus_queue.cc:1035] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:00.670885 15431 raft_consensus.cc:1261] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.679224 15361 raft_consensus.cc:1261] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.681231 15356 consensus_queue.cc:237] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:00.691458 16096 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:00.676095 16187 consensus_queue.cc:1035] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260929 11:36:00.692739 15898 consensus_queue.cc:1035] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:00.693529 16183 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:00.694492 15431 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:00.697798 16183 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:00.707803 16146 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.712436 15439 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.713022 16096 raft_consensus.cc:2932] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.715461 16187 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.722043 15361 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.730280 15260 catalog_manager.cc:5495] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.737380 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c7c9ca97877f48c9ba1c6a3503576624 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:00.744997 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet c7c9ca97877f48c9ba1c6a3503576624 with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:00.747006 16096 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.748405 15259 catalog_manager.cc:5495] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.742476 15439 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.762504 16194 tablet_replica.cc:330] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:00.763545 16194 raft_consensus.cc:2229] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:00.764231 16194 raft_consensus.cc:2258] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:00.767356 16194 ts_tablet_manager.cc:1905] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:00.773599 15509 consensus_queue.cc:237] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:00.782907 16194 ts_tablet_manager.cc:1918] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:00.783061 16096 raft_consensus.cc:1261] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:00.783509 16194 log.cc:1196] T c7c9ca97877f48c9ba1c6a3503576624 P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/c7c9ca97877f48c9ba1c6a3503576624
I20260929 11:36:00.784562 16187 consensus_queue.cc:1035] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:00.786230 15356 raft_consensus.cc:1261] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:00.788122 16187 consensus_queue.cc:1035] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:00.790292 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet c7c9ca97877f48c9ba1c6a3503576624 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:00.796207 15898 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.800998 16172 raft_consensus.cc:1050] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:00.802624 15356 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.803223 16172 consensus_queue.cc:237] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:00.805109 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e9bdacdc58094518aa9198105dee0e0b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:00.825450 15511 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.825474 16096 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.827116 16172 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:00.826704 15262 catalog_manager.cc:5495] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.827566 15439 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:00.831383 16096 raft_consensus.cc:2932] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.835966 16183 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:00.839516 16146 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:00.857889 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet e9bdacdc58094518aa9198105dee0e0b with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:00.869961 16199 tablet_replica.cc:330] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:00.874243 16183 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.879006 16199 raft_consensus.cc:2229] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:00.880263 16199 raft_consensus.cc:2258] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:00.884979 16199 ts_tablet_manager.cc:1905] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:00.887949 15511 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.890733 15439 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.894603 16096 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.906366 16199 ts_tablet_manager.cc:1918] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:00.906905 16199 log.cc:1196] T e9bdacdc58094518aa9198105dee0e0b P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/e9bdacdc58094518aa9198105dee0e0b
I20260929 11:36:00.908881 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet e9bdacdc58094518aa9198105dee0e0b (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:00.911935 15258 catalog_manager.cc:5495] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.950532 15364 consensus_queue.cc:237] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:00.955358 15511 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:00.955798 16096 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:00.956779 16200 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:00.958184 16183 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:00.965269 16172 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.966683 16096 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.972476 15511 raft_consensus.cc:2932] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.980631 15259 catalog_manager.cc:5495] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:00.981446 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 133f7cd27af34f7ebc89e90b65170522 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:00.991446 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet 133f7cd27af34f7ebc89e90b65170522 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:00.992390 16199 tablet_replica.cc:330] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:00.993361 16199 raft_consensus.cc:2229] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:00.994499 16199 raft_consensus.cc:2258] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:00.997364 16199 ts_tablet_manager.cc:1905] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:01.013294 16199 ts_tablet_manager.cc:1918] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:01.013705 16199 log.cc:1196] T 133f7cd27af34f7ebc89e90b65170522 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/133f7cd27af34f7ebc89e90b65170522
I20260929 11:36:01.015177 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet 133f7cd27af34f7ebc89e90b65170522 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:02.056972 15511 consensus_queue.cc:237] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
W20260929 11:36:02.063181 15479 consensus_peers.cc:487] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69f25939e19c461ab830dd08f6e6b790. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:02.063787 15431 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:02.064617 15356 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:02.065193 15898 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:02.066044 16189 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:02.073618 16189 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.075135 15431 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.077780 15356 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.088475 15364 consensus_queue.cc:237] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.094285 15258 catalog_manager.cc:5495] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:02.108004 15509 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:02.108130 15330 consensus_peers.cc:487] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06a45ce12d33457f8e8a937ebe912eff. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:02.109251 16202 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:02.110165 15438 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:02.112015 16172 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:02.123405 16202 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.131538 15431 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.148259 15509 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.170585 15364 consensus_queue.cc:237] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.190116 15509 raft_consensus.cc:1261] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:02.193558 15431 raft_consensus.cc:1261] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:02.194994 16210 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:02.196187 16146 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260929 11:36:02.200078 15330 consensus_peers.cc:487] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85b927b471cd474c88c32acd488f0492. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:02.209661 16146 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.223259 15513 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.226437 15509 consensus_queue.cc:237] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.227039 15262 catalog_manager.cc:5495] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:02.235132 15479 consensus_peers.cc:487] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e96d6ce3c2da47089d889e3b488fb3b8. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:02.235285 15431 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.238448 15438 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:02.240442 16204 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:02.245831 15364 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:02.247323 16204 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:02.263195 15259 catalog_manager.cc:5495] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:02.268040 16204 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.274737 15364 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.271821 15439 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.302896 15258 catalog_manager.cc:5495] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:02.614663 16222 ts_tablet_manager.cc:927] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:02.615265 16223 ts_tablet_manager.cc:927] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:02.616798 16222 tablet_copy_client.cc:316] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:02.618510 15523 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet e96d6ce3c2da47089d889e3b488fb3b8 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:02.618700 16223 tablet_copy_client.cc:316] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:02.619052 15523 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet e96d6ce3c2da47089d889e3b488fb3b8 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-e96d6ce3c2da47089d889e3b488fb3b8
I20260929 11:36:02.620206 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 06a45ce12d33457f8e8a937ebe912eff from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:02.620752 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 06a45ce12d33457f8e8a937ebe912eff from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-06a45ce12d33457f8e8a937ebe912eff
I20260929 11:36:02.625407 15523 tablet_copy_source_session.cc:205] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:02.628129 16222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e96d6ce3c2da47089d889e3b488fb3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:02.628903 15374 tablet_copy_source_session.cc:205] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:02.631608 16223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06a45ce12d33457f8e8a937ebe912eff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:02.645771 16222 tablet_copy_client.cc:791] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:02.646071 16223 tablet_copy_client.cc:791] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:02.646395 16222 tablet_copy_client.cc:655] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:02.646855 16223 tablet_copy_client.cc:655] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:02.650550 16222 tablet_copy_client.cc:531] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:02.654817 16223 tablet_copy_client.cc:531] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:02.659663 16222 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:02.663590 16223 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:02.689908 16222 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:02.690989 16222 tablet_bootstrap.cc:492] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:02.692219 16222 ts_tablet_manager.cc:1397] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.033s user 0.024s sys 0.009s
I20260929 11:36:02.694965 16222 raft_consensus.cc:348] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.696002 16223 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:02.696002 16222 raft_consensus.cc:729] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:02.697161 16227 ts_tablet_manager.cc:927] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:02.697009 16222 consensus_queue.cc:260] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.698477 16223 tablet_bootstrap.cc:492] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:02.699501 16223 ts_tablet_manager.cc:1397] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.036s user 0.032s sys 0.000s
I20260929 11:36:02.703454 16223 raft_consensus.cc:348] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.704783 16223 raft_consensus.cc:729] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:02.705713 16223 consensus_queue.cc:260] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.718425 16223 ts_tablet_manager.cc:1428] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260929 11:36:02.726136 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-06a45ce12d33457f8e8a937ebe912eff received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:02.726565 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-06a45ce12d33457f8e8a937ebe912eff on tablet 06a45ce12d33457f8e8a937ebe912eff with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:02.735700 16227 tablet_copy_client.cc:316] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:02.737733 15523 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet 69f25939e19c461ab830dd08f6e6b790 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:02.738255 15523 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet 69f25939e19c461ab830dd08f6e6b790 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-69f25939e19c461ab830dd08f6e6b790
I20260929 11:36:02.742537 16222 ts_tablet_manager.cc:1428] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.050s user 0.028s sys 0.016s
I20260929 11:36:02.746009 15522 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-e96d6ce3c2da47089d889e3b488fb3b8 received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:02.746912 15522 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-e96d6ce3c2da47089d889e3b488fb3b8 on tablet e96d6ce3c2da47089d889e3b488fb3b8 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:02.756400 15523 tablet_copy_source_session.cc:205] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:02.759220 16227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69f25939e19c461ab830dd08f6e6b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:02.772620 16227 tablet_copy_client.cc:791] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:02.773182 16227 tablet_copy_client.cc:655] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:02.776544 16227 tablet_copy_client.cc:531] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:02.780838 16222 ts_tablet_manager.cc:927] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:02.782367 16222 tablet_copy_client.cc:316] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:02.784359 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 85b927b471cd474c88c32acd488f0492 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:02.784861 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 85b927b471cd474c88c32acd488f0492 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-85b927b471cd474c88c32acd488f0492
I20260929 11:36:02.787412 16227 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:02.792445 15374 tablet_copy_source_session.cc:205] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:02.800047 16222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85b927b471cd474c88c32acd488f0492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:02.816401 16222 tablet_copy_client.cc:791] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:02.817040 16222 tablet_copy_client.cc:655] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:02.820562 16222 tablet_copy_client.cc:531] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:02.822976 16227 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:02.823843 16227 tablet_bootstrap.cc:492] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:02.824445 16227 ts_tablet_manager.cc:1397] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.037s user 0.030s sys 0.005s
I20260929 11:36:02.827632 16227 raft_consensus.cc:348] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.828370 16222 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:02.828548 16227 raft_consensus.cc:729] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:02.829336 16227 consensus_queue.cc:260] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.832381 16227 ts_tablet_manager.cc:1428] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260929 11:36:02.834568 15523 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-69f25939e19c461ab830dd08f6e6b790 received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:02.835065 15523 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-69f25939e19c461ab830dd08f6e6b790 on tablet 69f25939e19c461ab830dd08f6e6b790 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:02.857719 16222 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:02.858503 16222 tablet_bootstrap.cc:492] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:02.859185 16222 ts_tablet_manager.cc:1397] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.009s
I20260929 11:36:02.861744 16222 raft_consensus.cc:348] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.862591 16222 raft_consensus.cc:729] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:02.863137 16222 consensus_queue.cc:260] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:02.865130 16222 ts_tablet_manager.cc:1428] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260929 11:36:02.866740 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-85b927b471cd474c88c32acd488f0492 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:02.867141 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-85b927b471cd474c88c32acd488f0492 on tablet 85b927b471cd474c88c32acd488f0492 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:03.015519 16097 raft_consensus.cc:1203] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:03.068692 16097 raft_consensus.cc:1203] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:03.085106 16097 raft_consensus.cc:1203] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:03.305169 16097 raft_consensus.cc:1203] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:03.579615 16204 raft_consensus.cc:1050] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:03.582159 16204 consensus_queue.cc:237] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:03.591984 16097 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.592340 15898 raft_consensus.cc:1050] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:03.593865 15438 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.596639 16238 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.598300 16235 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.603854 15898 consensus_queue.cc:237] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:03.615339 15356 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.615538 16097 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.617532 16238 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.618005 16235 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.621591 15438 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.618973 16242 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.638711 15439 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.655354 15355 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.655819 15356 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.654481 15262 catalog_manager.cc:5495] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.659226 16235 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.661867 16235 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.666179 16096 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.691155 15509 consensus_queue.cc:237] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:03.692409 16146 raft_consensus.cc:1050] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:03.694649 16146 consensus_queue.cc:237] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:03.694546 16204 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.695662 15438 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.698581 16097 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:03.700199 16238 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:03.704361 15439 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:03.706279 16238 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:03.706174 15355 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.709322 16235 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.718580 16096 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.726637 15258 catalog_manager.cc:5495] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.753470 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 69f25939e19c461ab830dd08f6e6b790 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:03.766474 16096 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.771741 15438 raft_consensus.cc:2932] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.774829 15259 catalog_manager.cc:5495] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.785001 16252 raft_consensus.cc:1050] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:03.786949 16252 consensus_queue.cc:237] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:03.837530 16096 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.838857 16253 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.839427 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 69f25939e19c461ab830dd08f6e6b790 with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:03.841406 16259 tablet_replica.cc:330] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:03.842356 16259 raft_consensus.cc:2229] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:03.842960 16259 raft_consensus.cc:2258] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:03.846577 16259 ts_tablet_manager.cc:1905] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:03.847831 15435 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.851936 15511 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.860956 16236 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:03.863586 16259 ts_tablet_manager.cc:1918] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:03.864049 16259 log.cc:1196] T 69f25939e19c461ab830dd08f6e6b790 P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/69f25939e19c461ab830dd08f6e6b790
I20260929 11:36:03.868781 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 69f25939e19c461ab830dd08f6e6b790 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:03.868279 16256 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260929 11:36:03.876780 16097 raft_consensus.cc:1261] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.879263 16202 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.881750 15513 raft_consensus.cc:1261] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.885593 15432 raft_consensus.cc:1261] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:03.888485 15513 consensus_queue.cc:237] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:03.895391 16096 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:03.895521 15356 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:03.896075 16254 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:03.897174 16146 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:03.897174 16242 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:03.898216 16256 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.906847 16204 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:03.907359 15435 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.913636 16095 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.932344 16204 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.937383 16096 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.923255 15262 catalog_manager.cc:5495] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:03.949159 16202 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.945186 15511 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.956974 15356 raft_consensus.cc:2932] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.966898 16095 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.973309 15513 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.975689 15435 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:03.978143 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e96d6ce3c2da47089d889e3b488fb3b8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:03.986275 15259 catalog_manager.cc:5495] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.002487 15258 catalog_manager.cc:5495] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.001472 15355 consensus_queue.cc:237] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:04.011082 16095 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:04.012513 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet e96d6ce3c2da47089d889e3b488fb3b8 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:04.012374 16256 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:04.014670 16266 tablet_replica.cc:330] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:04.018051 15435 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:04.020282 16266 raft_consensus.cc:2229] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:04.021054 16266 raft_consensus.cc:2258] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:04.023594 16202 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.026069 16095 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.028716 16252 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:04.034576 15435 raft_consensus.cc:2932] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.036614 15364 consensus_queue.cc:237] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:04.044027 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 06a45ce12d33457f8e8a937ebe912eff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:04.044184 16266 ts_tablet_manager.cc:1905] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:04.049033 15432 raft_consensus.cc:1261] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:04.050864 16252 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:04.053679 15260 catalog_manager.cc:5495] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.066956 16202 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.068408 16266 ts_tablet_manager.cc:1918] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:04.068853 16266 log.cc:1196] T e96d6ce3c2da47089d889e3b488fb3b8 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/e96d6ce3c2da47089d889e3b488fb3b8
I20260929 11:36:04.066154 16095 raft_consensus.cc:1261] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:04.071424 16253 consensus_queue.cc:1035] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:04.071633 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet e96d6ce3c2da47089d889e3b488fb3b8 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:04.080777 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 06a45ce12d33457f8e8a937ebe912eff with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:04.084501 16267 tablet_replica.cc:330] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:04.085515 16267 raft_consensus.cc:2229] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:04.086162 16267 raft_consensus.cc:2258] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:04.087244 15260 catalog_manager.cc:5495] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:04.090854 16267 ts_tablet_manager.cc:1905] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:04.092877 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 85b927b471cd474c88c32acd488f0492 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:04.077214 16095 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.093621 15435 raft_consensus.cc:2932] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:04.104614 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 85b927b471cd474c88c32acd488f0492 with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:04.115307 16267 ts_tablet_manager.cc:1918] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:04.115726 16267 log.cc:1196] T 06a45ce12d33457f8e8a937ebe912eff P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/06a45ce12d33457f8e8a937ebe912eff
I20260929 11:36:04.117096 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 06a45ce12d33457f8e8a937ebe912eff (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:04.117246 16267 tablet_replica.cc:330] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:04.118026 16267 raft_consensus.cc:2229] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:04.118548 16267 raft_consensus.cc:2258] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:04.121865 16267 ts_tablet_manager.cc:1905] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:04.134550 16267 ts_tablet_manager.cc:1918] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:04.134949 16267 log.cc:1196] T 85b927b471cd474c88c32acd488f0492 P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/85b927b471cd474c88c32acd488f0492
I20260929 11:36:04.136801 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 85b927b471cd474c88c32acd488f0492 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:05.177246 15432 consensus_queue.cc:237] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.184820 15513 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:05.186386 15405 consensus_peers.cc:487] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7721312177b84c71ae4f6bea151091a8. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:05.186616 15975 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:05.187062 15356 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:05.188403 16213 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:05.194700 15975 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.196457 15509 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.198336 15356 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.213791 15260 catalog_manager.cc:5495] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:05.223708 15432 consensus_queue.cc:237] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.253373 15509 raft_consensus.cc:1261] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:05.254834 15364 raft_consensus.cc:1261] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:05.255317 15975 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260929 11:36:05.256533 15405 consensus_peers.cc:487] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4f3d509852942e2b45c13e1f5c5ea8d. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:05.256686 16276 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:05.270893 16213 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.275036 15509 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.285003 15356 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.297525 15364 consensus_queue.cc:237] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.305357 15261 catalog_manager.cc:5495] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:05.318804 15509 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:05.320114 15330 consensus_peers.cc:487] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 082d372bd5004d6e90543b4fe1ba1b88. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:05.326647 16256 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:05.327015 15432 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:05.337150 16202 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:05.357970 16252 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.359753 15511 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.361436 15431 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.372150 15435 consensus_queue.cc:237] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.376125 15261 catalog_manager.cc:5495] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.389246 15511 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:05.389313 15405 consensus_peers.cc:487] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1839f2d147ac4c7a91bafb727fb103cd. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:05.389444 15364 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:05.390941 15975 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:05.391958 16213 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:05.403966 16213 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.405503 15364 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.406567 15511 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:05.419569 15260 catalog_manager.cc:5495] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:05.650050 16287 ts_tablet_manager.cc:927] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:05.654316 16287 tablet_copy_client.cc:316] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:05.656381 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet e4f3d509852942e2b45c13e1f5c5ea8d from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:05.656953 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet e4f3d509852942e2b45c13e1f5c5ea8d from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-e4f3d509852942e2b45c13e1f5c5ea8d
I20260929 11:36:05.665812 15449 tablet_copy_source_session.cc:205] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:05.669026 16287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4f3d509852942e2b45c13e1f5c5ea8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:05.682138 16287 tablet_copy_client.cc:791] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:05.682920 16287 tablet_copy_client.cc:655] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:05.687964 16287 tablet_copy_client.cc:531] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:05.696038 16287 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:05.727466 16287 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:05.728538 16287 tablet_bootstrap.cc:492] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:05.729163 16287 ts_tablet_manager.cc:1397] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.016s
I20260929 11:36:05.731752 16287 raft_consensus.cc:348] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.732774 16287 raft_consensus.cc:729] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:05.733716 16287 consensus_queue.cc:260] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.740124 16287 ts_tablet_manager.cc:1428] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.011s user 0.005s sys 0.005s
I20260929 11:36:05.743260 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-e4f3d509852942e2b45c13e1f5c5ea8d received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:05.743717 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-e4f3d509852942e2b45c13e1f5c5ea8d on tablet e4f3d509852942e2b45c13e1f5c5ea8d with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:05.769395 16287 ts_tablet_manager.cc:927] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:05.775373 16287 tablet_copy_client.cc:316] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:05.777189 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 082d372bd5004d6e90543b4fe1ba1b88 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:05.777688 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 082d372bd5004d6e90543b4fe1ba1b88 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-082d372bd5004d6e90543b4fe1ba1b88
I20260929 11:36:05.785496 15374 tablet_copy_source_session.cc:205] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:05.792471 16292 ts_tablet_manager.cc:927] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:05.793233 16287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 082d372bd5004d6e90543b4fe1ba1b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:05.799854 16292 tablet_copy_client.cc:316] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:05.801677 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 7721312177b84c71ae4f6bea151091a8 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:05.802203 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 7721312177b84c71ae4f6bea151091a8 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-7721312177b84c71ae4f6bea151091a8
I20260929 11:36:05.808617 15449 tablet_copy_source_session.cc:205] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:05.810060 16287 tablet_copy_client.cc:791] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:05.810660 16287 tablet_copy_client.cc:655] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:05.811831 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7721312177b84c71ae4f6bea151091a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:05.814304 16287 tablet_copy_client.cc:531] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:05.827215 16287 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:05.828761 16292 tablet_copy_client.cc:791] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:05.829489 16292 tablet_copy_client.cc:655] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:05.833372 16292 tablet_copy_client.cc:531] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:05.842981 16292 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:05.847654 16287 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:05.848668 16287 tablet_bootstrap.cc:492] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:05.849402 16287 ts_tablet_manager.cc:1397] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.022s user 0.018s sys 0.002s
I20260929 11:36:05.852001 16287 raft_consensus.cc:348] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.852782 16287 raft_consensus.cc:729] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:05.864457 16287 consensus_queue.cc:260] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.867810 16287 ts_tablet_manager.cc:1428] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20260929 11:36:05.878778 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-082d372bd5004d6e90543b4fe1ba1b88 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:05.879196 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-082d372bd5004d6e90543b4fe1ba1b88 on tablet 082d372bd5004d6e90543b4fe1ba1b88 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:05.890326 16292 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:05.891206 16292 tablet_bootstrap.cc:492] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:05.891871 16292 ts_tablet_manager.cc:1397] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.049s user 0.018s sys 0.011s
I20260929 11:36:05.894506 16292 raft_consensus.cc:348] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.895424 16292 raft_consensus.cc:729] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:05.896045 16292 consensus_queue.cc:260] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:05.898931 16292 ts_tablet_manager.cc:1428] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260929 11:36:05.900820 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-7721312177b84c71ae4f6bea151091a8 received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:05.901196 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-7721312177b84c71ae4f6bea151091a8 on tablet 7721312177b84c71ae4f6bea151091a8 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:05.974678 16292 ts_tablet_manager.cc:927] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:05.976401 16292 tablet_copy_client.cc:316] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:05.977917 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 1839f2d147ac4c7a91bafb727fb103cd from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:05.978427 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 1839f2d147ac4c7a91bafb727fb103cd from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-1839f2d147ac4c7a91bafb727fb103cd
I20260929 11:36:05.984851 15449 tablet_copy_source_session.cc:205] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:05.987756 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1839f2d147ac4c7a91bafb727fb103cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:06.000536 16292 tablet_copy_client.cc:791] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:06.001176 16292 tablet_copy_client.cc:655] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:06.004393 16292 tablet_copy_client.cc:531] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:06.012444 16292 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:06.031126 16292 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:06.032119 16292 tablet_bootstrap.cc:492] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:06.032866 16292 ts_tablet_manager.cc:1397] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.021s user 0.021s sys 0.001s
I20260929 11:36:06.035537 16292 raft_consensus.cc:348] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:06.036428 16292 raft_consensus.cc:729] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:06.037068 16292 consensus_queue.cc:260] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:06.039127 16292 ts_tablet_manager.cc:1428] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260929 11:36:06.041744 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-1839f2d147ac4c7a91bafb727fb103cd received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:06.042171 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-1839f2d147ac4c7a91bafb727fb103cd on tablet 1839f2d147ac4c7a91bafb727fb103cd with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:06.146708 16095 raft_consensus.cc:1203] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:06.213909 16095 raft_consensus.cc:1203] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:06.333345 16095 raft_consensus.cc:1203] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:06.545679 16276 raft_consensus.cc:1050] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:06.547803 16276 consensus_queue.cc:237] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:06.557164 16095 raft_consensus.cc:1203] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:06.569813 16095 raft_consensus.cc:1261] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.571180 16213 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:06.572229 15509 raft_consensus.cc:1261] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.573657 15975 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:06.584409 15364 raft_consensus.cc:1261] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.586165 16213 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:06.590425 15975 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.593366 15509 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.597401 15364 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.601126 16095 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.607174 15261 catalog_manager.cc:5495] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:06.636376 15439 consensus_queue.cc:237] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:06.658768 16095 raft_consensus.cc:1261] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:06.662992 15509 raft_consensus.cc:1261] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:06.668567 16276 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:06.669433 16307 consensus_queue.cc:1035] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:06.680235 16213 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.681630 15509 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.681470 16095 raft_consensus.cc:2932] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.702924 15259 catalog_manager.cc:5495] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.707757 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e4f3d509852942e2b45c13e1f5c5ea8d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:06.717172 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet e4f3d509852942e2b45c13e1f5c5ea8d with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:06.719238 16309 tablet_replica.cc:330] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:06.721369 16309 raft_consensus.cc:2229] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:06.721969 16309 raft_consensus.cc:2258] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:06.725622 16309 ts_tablet_manager.cc:1905] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:06.739565 16256 raft_consensus.cc:1050] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:06.742508 16309 ts_tablet_manager.cc:1918] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:06.742182 16256 consensus_queue.cc:237] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:06.742975 16309 log.cc:1196] T e4f3d509852942e2b45c13e1f5c5ea8d P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/e4f3d509852942e2b45c13e1f5c5ea8d
I20260929 11:36:06.745993 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet e4f3d509852942e2b45c13e1f5c5ea8d (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:06.753479 15509 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.754040 16095 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.755425 16252 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:06.756628 16202 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:06.762012 15431 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.763746 16202 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:06.794603 15431 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.794638 15509 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.788841 16202 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.810653 16095 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.815945 15258 catalog_manager.cc:5495] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.829052 16308 raft_consensus.cc:1050] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:06.831439 16308 consensus_queue.cc:237] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:06.847326 15356 consensus_queue.cc:237] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:06.853669 16096 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:06.853885 15509 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:06.857254 16202 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:06.858261 16256 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:06.869359 16252 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.870213 15511 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.871148 16096 raft_consensus.cc:2932] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.891211 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 082d372bd5004d6e90543b4fe1ba1b88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:06.891741 15356 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.891389 15260 catalog_manager.cc:5495] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.894089 16276 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:06.896974 16095 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.898958 16276 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:06.909881 15509 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:06.921305 16308 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:06.927706 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet 082d372bd5004d6e90543b4fe1ba1b88 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:06.930068 16318 tablet_replica.cc:330] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:06.941598 16318 raft_consensus.cc:2229] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:06.942582 16318 raft_consensus.cc:2258] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:06.948882 16318 ts_tablet_manager.cc:1905] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:06.950156 15356 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.952117 16307 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.952711 15513 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.970708 15260 catalog_manager.cc:5495] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.971634 16096 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:06.987928 16318 ts_tablet_manager.cc:1918] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:06.990222 15439 consensus_queue.cc:237] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:06.990916 16318 log.cc:1196] T 082d372bd5004d6e90543b4fe1ba1b88 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/082d372bd5004d6e90543b4fe1ba1b88
I20260929 11:36:06.991523 16307 raft_consensus.cc:1050] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:06.993242 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet 082d372bd5004d6e90543b4fe1ba1b88 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:06.994011 16307 consensus_queue.cc:237] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:06.995479 16096 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:06.996052 15513 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:06.996871 16276 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:06.997748 16213 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:07.002318 16096 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:07.003439 15511 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:07.006484 15356 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:07.007477 15975 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:07.008301 16308 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:07.008180 16321 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.010972 15975 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:07.019156 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7721312177b84c71ae4f6bea151091a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:07.023897 15513 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.024694 16095 raft_consensus.cc:2932] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.032872 15260 catalog_manager.cc:5495] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:07.045433 16307 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.050267 15509 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.053532 16097 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.057288 15356 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.064972 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 7721312177b84c71ae4f6bea151091a8 with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:07.066032 16309 tablet_replica.cc:330] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:07.067005 16309 raft_consensus.cc:2229] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:07.067655 16309 raft_consensus.cc:2258] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:07.070991 16309 ts_tablet_manager.cc:1905] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:07.084090 15261 catalog_manager.cc:5495] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:07.104067 16309 ts_tablet_manager.cc:1918] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:07.104588 16309 log.cc:1196] T 7721312177b84c71ae4f6bea151091a8 P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/7721312177b84c71ae4f6bea151091a8
I20260929 11:36:07.105572 15439 consensus_queue.cc:237] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:07.106868 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 7721312177b84c71ae4f6bea151091a8 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:07.111320 15356 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:07.111636 16097 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:07.113087 16213 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:07.114639 16213 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:07.122808 16308 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.125372 16097 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.126461 15356 raft_consensus.cc:2932] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.134034 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 1839f2d147ac4c7a91bafb727fb103cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:07.143260 15260 catalog_manager.cc:5495] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:07.155023 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 1839f2d147ac4c7a91bafb727fb103cd with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:07.156867 16325 tablet_replica.cc:330] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:07.162257 16325 raft_consensus.cc:2229] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:07.162990 16325 raft_consensus.cc:2258] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:07.166177 16325 ts_tablet_manager.cc:1905] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:07.179903 16325 ts_tablet_manager.cc:1918] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:07.180369 16325 log.cc:1196] T 1839f2d147ac4c7a91bafb727fb103cd P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/1839f2d147ac4c7a91bafb727fb103cd
I20260929 11:36:07.181734 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 1839f2d147ac4c7a91bafb727fb103cd (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:08.209335 15359 consensus_queue.cc:237] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
W20260929 11:36:08.215881 15330 consensus_peers.cc:487] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 293283a1ffae44dfb01a86f8eaf344f0. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:08.216382 15509 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:08.216922 15439 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:08.217645 16332 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:08.218467 16330 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:08.230111 16202 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.231415 15439 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.232503 15510 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.252625 15506 consensus_queue.cc:237] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:08.258169 15260 catalog_manager.cc:5495] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.266462 15439 raft_consensus.cc:1261] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:08.267954 15479 consensus_peers.cc:487] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e37a9bc249c74356a37d92fe9124c7cc. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:08.267876 16327 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:08.277592 15359 raft_consensus.cc:1261] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:08.286064 16327 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260929 11:36:08.293696 16326 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.300150 15438 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.309773 15506 consensus_queue.cc:237] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:08.314838 15356 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.346724 15439 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:08.348579 15479 consensus_peers.cc:487] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f9ef265661b4a1b872b075ece5bb40d. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:08.350664 16326 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:08.364777 16327 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.366500 15435 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.397565 15261 catalog_manager.cc:5495] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:08.401151 15361 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:08.403084 16326 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:08.410099 15361 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.413847 15356 consensus_queue.cc:237] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:08.426888 15435 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:08.426901 15506 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:08.428897 16330 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260929 11:36:08.430444 15330 consensus_peers.cc:487] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7eb6a5845e93469fb6516bd75d62c983. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:08.431676 16331 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:08.433478 15258 catalog_manager.cc:5495] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.438954 16330 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.441190 15435 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.461014 15506 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.476060 15258 catalog_manager.cc:5495] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:08.799567 16359 ts_tablet_manager.cc:927] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:08.805516 16359 tablet_copy_client.cc:316] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:08.806918 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 293283a1ffae44dfb01a86f8eaf344f0 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:08.807906 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 293283a1ffae44dfb01a86f8eaf344f0 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-293283a1ffae44dfb01a86f8eaf344f0
I20260929 11:36:08.822750 16361 ts_tablet_manager.cc:927] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:08.827543 15374 tablet_copy_source_session.cc:205] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:08.831287 16359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293283a1ffae44dfb01a86f8eaf344f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:08.832760 16361 tablet_copy_client.cc:316] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:08.835306 15523 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet e37a9bc249c74356a37d92fe9124c7cc from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:08.835814 15523 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet e37a9bc249c74356a37d92fe9124c7cc from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-e37a9bc249c74356a37d92fe9124c7cc
I20260929 11:36:08.846927 15523 tablet_copy_source_session.cc:205] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
W20260929 11:36:08.850284 15534 debug-util.cc:398] Leaking SignalData structure 0x7b080009cf40 after lost signal to thread 14202
W20260929 11:36:08.851343 15534 debug-util.cc:398] Leaking SignalData structure 0x7b0800178380 after lost signal to thread 15296
W20260929 11:36:08.852468 15534 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2be0 after lost signal to thread 15388
W20260929 11:36:08.853478 15534 debug-util.cc:398] Leaking SignalData structure 0x7b0800323360 after lost signal to thread 15463
W20260929 11:36:08.854449 15534 debug-util.cc:398] Leaking SignalData structure 0x7b08002f38a0 after lost signal to thread 15537
W20260929 11:36:08.855484 15534 debug-util.cc:398] Leaking SignalData structure 0x7b08002cdde0 after lost signal to thread 16121
I20260929 11:36:08.861614 16361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e37a9bc249c74356a37d92fe9124c7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:08.874989 16359 tablet_copy_client.cc:791] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:08.878623 16359 tablet_copy_client.cc:655] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:08.882776 16359 tablet_copy_client.cc:531] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:08.889142 16363 ts_tablet_manager.cc:927] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:08.890103 16361 tablet_copy_client.cc:791] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:08.890689 16361 tablet_copy_client.cc:655] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:08.894949 16359 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:08.897954 16361 tablet_copy_client.cc:531] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:08.908849 16363 tablet_copy_client.cc:316] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:08.910948 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 7eb6a5845e93469fb6516bd75d62c983 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:08.911511 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 7eb6a5845e93469fb6516bd75d62c983 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-7eb6a5845e93469fb6516bd75d62c983
I20260929 11:36:08.916188 16361 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:08.930085 15374 tablet_copy_source_session.cc:205] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:08.935480 16363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eb6a5845e93469fb6516bd75d62c983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:08.940177 16359 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:08.941110 16359 tablet_bootstrap.cc:492] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:08.941773 16359 ts_tablet_manager.cc:1397] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.047s user 0.014s sys 0.013s
I20260929 11:36:08.944492 16359 raft_consensus.cc:348] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:08.945319 16359 raft_consensus.cc:729] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:08.945917 16359 consensus_queue.cc:260] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:08.956789 16359 ts_tablet_manager.cc:1428] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.015s user 0.010s sys 0.005s
I20260929 11:36:08.958393 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-293283a1ffae44dfb01a86f8eaf344f0 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:08.959630 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-293283a1ffae44dfb01a86f8eaf344f0 on tablet 293283a1ffae44dfb01a86f8eaf344f0 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:08.973464 16359 ts_tablet_manager.cc:927] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:08.977741 16363 tablet_copy_client.cc:791] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:08.979640 16363 tablet_copy_client.cc:655] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:08.990196 16363 tablet_copy_client.cc:531] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:09.000540 16359 tablet_copy_client.cc:316] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:09.002324 15523 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet 2f9ef265661b4a1b872b075ece5bb40d from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:09.003065 15523 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet 2f9ef265661b4a1b872b075ece5bb40d from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-2f9ef265661b4a1b872b075ece5bb40d
I20260929 11:36:09.010766 16363 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:09.018268 16361 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:09.019210 16361 tablet_bootstrap.cc:492] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:09.019913 16361 ts_tablet_manager.cc:1397] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.104s user 0.028s sys 0.041s
I20260929 11:36:09.022944 16361 raft_consensus.cc:348] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:09.023840 16361 raft_consensus.cc:729] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:09.024521 16361 consensus_queue.cc:260] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:09.022583 15523 tablet_copy_source_session.cc:205] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:09.028801 16359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f9ef265661b4a1b872b075ece5bb40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:09.029738 16361 ts_tablet_manager.cc:1428] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260929 11:36:09.043623 15523 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-e37a9bc249c74356a37d92fe9124c7cc received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:09.044059 15523 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-e37a9bc249c74356a37d92fe9124c7cc on tablet e37a9bc249c74356a37d92fe9124c7cc with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:09.052482 16359 tablet_copy_client.cc:791] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:09.053167 16359 tablet_copy_client.cc:655] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:09.056744 16359 tablet_copy_client.cc:531] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:09.122285 16363 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:09.122767 16359 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:09.140977 16363 tablet_bootstrap.cc:492] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:09.141763 16363 ts_tablet_manager.cc:1397] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.131s user 0.027s sys 0.017s
I20260929 11:36:09.145272 16363 raft_consensus.cc:348] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:09.157745 16363 raft_consensus.cc:729] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:09.158743 16363 consensus_queue.cc:260] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:09.169427 16363 ts_tablet_manager.cc:1428] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.027s user 0.007s sys 0.001s
I20260929 11:36:09.177943 16359 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:09.178857 16359 tablet_bootstrap.cc:492] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:09.179519 16359 ts_tablet_manager.cc:1397] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.057s user 0.022s sys 0.005s
I20260929 11:36:09.182196 16359 raft_consensus.cc:348] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:09.184787 16359 raft_consensus.cc:729] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:09.185441 16359 consensus_queue.cc:260] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:09.188150 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-7eb6a5845e93469fb6516bd75d62c983 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:09.188607 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-7eb6a5845e93469fb6516bd75d62c983 on tablet 7eb6a5845e93469fb6516bd75d62c983 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:09.192166 16359 ts_tablet_manager.cc:1428] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.012s user 0.006s sys 0.004s
I20260929 11:36:09.200232 15523 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-2f9ef265661b4a1b872b075ece5bb40d received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:09.200758 15523 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-2f9ef265661b4a1b872b075ece5bb40d on tablet 2f9ef265661b4a1b872b075ece5bb40d with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:09.311192 16097 raft_consensus.cc:1203] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:09.365598 16095 raft_consensus.cc:1203] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:09.372879 16095 raft_consensus.cc:1203] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:09.414973 16095 raft_consensus.cc:1203] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:09.804009 16337 raft_consensus.cc:1050] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:09.806870 16337 consensus_queue.cc:237] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:09.830423 15439 raft_consensus.cc:1261] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.829188 16095 raft_consensus.cc:1261] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.832573 16326 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:09.832794 15361 raft_consensus.cc:1261] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.833508 16327 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:09.846293 16337 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:09.860422 16374 raft_consensus.cc:1050] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:09.875972 16374 consensus_queue.cc:237] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:09.878738 16378 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:09.882552 16095 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:09.886408 15361 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:09.891532 16332 raft_consensus.cc:1050] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:09.898720 16332 consensus_queue.cc:237] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:09.904742 15439 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:09.919224 16097 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.920300 15258 catalog_manager.cc:5495] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:09.924012 16202 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:09.926632 15512 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.928150 15435 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.934406 16333 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:09.936918 16333 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:09.960505 16332 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:09.969419 15435 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:09.974213 15438 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.975633 16097 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.983423 15361 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:09.982960 16097 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:09.985558 16337 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:09.986464 16378 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:09.994091 16332 raft_consensus.cc:1050] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:09.996960 16332 consensus_queue.cc:237] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:09.988219 16378 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260929 11:36:10.017895 15506 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.087855 16327 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.094285 16096 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.107393 15510 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:10.107666 15439 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:10.108847 16096 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:10.109278 16202 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:10.109349 15361 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.111001 15435 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.115761 16202 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:10.120464 16333 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:10.160449 15510 consensus_queue.cc:237] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:10.163723 16332 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.166416 15260 catalog_manager.cc:5495] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.172936 15439 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.175117 16096 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.168079 15260 catalog_manager.cc:5495] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.182047 15438 raft_consensus.cc:1261] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:10.185142 16097 raft_consensus.cc:1261] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:10.186339 16326 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:10.188768 16326 consensus_queue.cc:1035] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:10.190773 15510 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.201218 16327 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.212525 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e37a9bc249c74356a37d92fe9124c7cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:10.212978 15435 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.228065 15258 catalog_manager.cc:5495] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.224112 16095 raft_consensus.cc:2932] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.239902 15506 consensus_queue.cc:237] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:10.247876 15361 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:10.253487 15259 catalog_manager.cc:5495] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:10.258312 15361 consensus_queue.cc:237] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:10.265236 16378 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:10.267180 16095 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:10.267915 15510 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:10.269202 16097 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:10.270651 16378 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:10.268492 16395 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260929 11:36:10.275632 16381 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:10.280236 16326 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.285737 16333 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.294242 16097 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.298949 16095 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.302279 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 2f9ef265661b4a1b872b075ece5bb40d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:10.298949 15361 raft_consensus.cc:2932] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.312974 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7eb6a5845e93469fb6516bd75d62c983 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:10.313572 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet e37a9bc249c74356a37d92fe9124c7cc with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:10.327744 15260 catalog_manager.cc:5495] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:10.330511 15258 catalog_manager.cc:5495] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.342335 16400 tablet_replica.cc:330] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:10.345923 15506 raft_consensus.cc:2932] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.358560 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eb6a5845e93469fb6516bd75d62c983 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:10.381659 15361 consensus_queue.cc:237] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:10.383425 16400 raft_consensus.cc:2229] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:10.384176 16400 raft_consensus.cc:2258] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:10.387775 15439 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:10.390379 16333 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:10.393996 16400 ts_tablet_manager.cc:1905] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:10.401144 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f9ef265661b4a1b872b075ece5bb40d with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:10.404623 16095 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:10.406117 16202 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:10.405596 16395 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.410404 16097 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.420053 15439 raft_consensus.cc:2932] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.423492 16401 tablet_replica.cc:330] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:10.439169 16401 raft_consensus.cc:2229] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:10.440591 16401 raft_consensus.cc:2258] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:10.427320 16400 ts_tablet_manager.cc:1918] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:10.444002 16401 ts_tablet_manager.cc:1905] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:10.445079 16400 log.cc:1196] T e37a9bc249c74356a37d92fe9124c7cc P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/e37a9bc249c74356a37d92fe9124c7cc
I20260929 11:36:10.447269 15260 catalog_manager.cc:5495] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:10.455886 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 293283a1ffae44dfb01a86f8eaf344f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:10.456997 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet e37a9bc249c74356a37d92fe9124c7cc (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:10.468276 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 293283a1ffae44dfb01a86f8eaf344f0 with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:10.469460 16401 ts_tablet_manager.cc:1918] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:10.476238 16401 log.cc:1196] T 7eb6a5845e93469fb6516bd75d62c983 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/7eb6a5845e93469fb6516bd75d62c983
I20260929 11:36:10.474623 16403 tablet_replica.cc:330] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:10.478235 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet 7eb6a5845e93469fb6516bd75d62c983 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:10.478660 16401 tablet_replica.cc:330] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:10.478567 16403 raft_consensus.cc:2229] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:10.479727 16403 raft_consensus.cc:2258] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:10.479827 16401 raft_consensus.cc:2229] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:10.481197 16401 raft_consensus.cc:2258] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:10.483870 16403 ts_tablet_manager.cc:1905] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:10.484421 16401 ts_tablet_manager.cc:1905] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:10.501093 16403 ts_tablet_manager.cc:1918] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:10.501572 16403 log.cc:1196] T 293283a1ffae44dfb01a86f8eaf344f0 P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/293283a1ffae44dfb01a86f8eaf344f0
I20260929 11:36:10.503526 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 293283a1ffae44dfb01a86f8eaf344f0 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:10.504407 16401 ts_tablet_manager.cc:1918] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:10.504873 16401 log.cc:1196] T 2f9ef265661b4a1b872b075ece5bb40d P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/2f9ef265661b4a1b872b075ece5bb40d
I20260929 11:36:10.507557 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet 2f9ef265661b4a1b872b075ece5bb40d (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:11.564227 15439 consensus_queue.cc:237] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:11.569830 15361 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:11.571225 15405 consensus_peers.cc:487] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5af50e35934e4cd3960c886105fb34b7. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:11.571368 15510 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:11.571815 15975 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:11.572861 16329 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:11.584048 16407 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.586380 15361 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.607963 15261 catalog_manager.cc:5495] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.610633 15439 consensus_queue.cc:237] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:11.621227 15506 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:11.647869 15405 consensus_peers.cc:487] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae0c7572ce72494f9c505c54480619fa. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:11.652462 15361 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:11.652997 15506 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:11.654338 16407 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:11.656186 16407 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:11.680759 16329 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.683972 15361 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.687058 15512 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.694788 15359 consensus_queue.cc:237] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:11.701756 15260 catalog_manager.cc:5495] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:11.719350 15330 consensus_peers.cc:487] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85688ae966734650b9fca8130f2feb8c. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:11.721989 15510 raft_consensus.cc:1261] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:11.723417 15439 raft_consensus.cc:1261] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:11.723587 16405 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:11.725168 16402 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:11.757115 16405 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.787230 15506 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.797078 15259 catalog_manager.cc:5495] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:11.797919 15359 consensus_queue.cc:237] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:11.797165 15439 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:11.829305 15330 consensus_peers.cc:487] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9309f2844e444faaf2fbd9f0b77b132. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:11.831612 15506 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:11.831888 15439 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:11.833276 16406 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:11.836833 16406 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:11.845151 16202 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.847371 15512 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:11.869791 15260 catalog_manager.cc:5495] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:11.886381 15435 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:12.066251 16426 ts_tablet_manager.cc:927] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:12.078691 16426 tablet_copy_client.cc:316] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:12.081332 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 5af50e35934e4cd3960c886105fb34b7 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:12.081920 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 5af50e35934e4cd3960c886105fb34b7 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-5af50e35934e4cd3960c886105fb34b7
I20260929 11:36:12.092136 15449 tablet_copy_source_session.cc:205] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:12.097231 16426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5af50e35934e4cd3960c886105fb34b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:12.117293 16426 tablet_copy_client.cc:791] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:12.118049 16426 tablet_copy_client.cc:655] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:12.125041 16426 tablet_copy_client.cc:531] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:12.140264 16426 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:12.169252 16426 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:12.170147 16426 tablet_bootstrap.cc:492] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:12.170838 16426 ts_tablet_manager.cc:1397] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.010s
I20260929 11:36:12.185061 16426 raft_consensus.cc:348] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:12.186018 16426 raft_consensus.cc:729] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:12.187180 16426 consensus_queue.cc:260] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:12.193717 16426 ts_tablet_manager.cc:1428] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.023s user 0.009s sys 0.001s
I20260929 11:36:12.202616 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-5af50e35934e4cd3960c886105fb34b7 received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:12.203060 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-5af50e35934e4cd3960c886105fb34b7 on tablet 5af50e35934e4cd3960c886105fb34b7 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:12.216725 16426 ts_tablet_manager.cc:927] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:12.232048 16432 ts_tablet_manager.cc:927] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:12.248963 16432 tablet_copy_client.cc:316] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:12.250519 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 85688ae966734650b9fca8130f2feb8c from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:12.251065 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 85688ae966734650b9fca8130f2feb8c from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-85688ae966734650b9fca8130f2feb8c
I20260929 11:36:12.271237 16426 tablet_copy_client.cc:316] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:12.273104 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet ae0c7572ce72494f9c505c54480619fa from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:12.273631 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet ae0c7572ce72494f9c505c54480619fa from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-ae0c7572ce72494f9c505c54480619fa
I20260929 11:36:12.274569 15374 tablet_copy_source_session.cc:205] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:12.282434 15449 tablet_copy_source_session.cc:205] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:12.278059 16432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85688ae966734650b9fca8130f2feb8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:12.291420 16426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae0c7572ce72494f9c505c54480619fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:12.306799 16426 tablet_copy_client.cc:791] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:12.307410 16426 tablet_copy_client.cc:655] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:12.314195 16426 tablet_copy_client.cc:531] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:12.315603 16432 tablet_copy_client.cc:791] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:12.316236 16432 tablet_copy_client.cc:655] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:12.319990 16432 tablet_copy_client.cc:531] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:12.324610 16426 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:12.329471 16432 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:12.361123 16426 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:12.362085 16426 tablet_bootstrap.cc:492] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:12.362803 16426 ts_tablet_manager.cc:1397] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.020s
I20260929 11:36:12.371557 16426 raft_consensus.cc:348] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:12.372521 16426 raft_consensus.cc:729] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:12.373206 16426 consensus_queue.cc:260] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:12.375403 16426 ts_tablet_manager.cc:1428] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260929 11:36:12.375458 16432 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:12.376951 16432 tablet_bootstrap.cc:492] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:12.377164 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-ae0c7572ce72494f9c505c54480619fa received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:12.377558 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-ae0c7572ce72494f9c505c54480619fa on tablet ae0c7572ce72494f9c505c54480619fa with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:12.377594 16432 ts_tablet_manager.cc:1397] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.048s user 0.024s sys 0.001s
I20260929 11:36:12.383445 16432 raft_consensus.cc:348] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:12.384210 16432 raft_consensus.cc:729] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:12.386101 16432 consensus_queue.cc:260] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:12.388967 16432 ts_tablet_manager.cc:1428] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260929 11:36:12.390856 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-85688ae966734650b9fca8130f2feb8c received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:12.391287 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-85688ae966734650b9fca8130f2feb8c on tablet 85688ae966734650b9fca8130f2feb8c with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:12.417578 16432 ts_tablet_manager.cc:927] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:12.422001 16432 tablet_copy_client.cc:316] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:12.426977 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet e9309f2844e444faaf2fbd9f0b77b132 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:12.427610 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet e9309f2844e444faaf2fbd9f0b77b132 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-e9309f2844e444faaf2fbd9f0b77b132
I20260929 11:36:12.437592 15374 tablet_copy_source_session.cc:205] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:12.441949 16432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9309f2844e444faaf2fbd9f0b77b132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:12.457309 16095 raft_consensus.cc:1203] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:12.481112 16432 tablet_copy_client.cc:791] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:12.482416 16432 tablet_copy_client.cc:655] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:12.486656 16432 tablet_copy_client.cc:531] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:12.502755 16432 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:12.528268 16432 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:12.529317 16432 tablet_bootstrap.cc:492] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:12.530112 16432 ts_tablet_manager.cc:1397] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.028s user 0.018s sys 0.005s
I20260929 11:36:12.533191 16432 raft_consensus.cc:348] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:12.534137 16432 raft_consensus.cc:729] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:12.534847 16432 consensus_queue.cc:260] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:12.540518 16432 ts_tablet_manager.cc:1428] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260929 11:36:12.542934 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-e9309f2844e444faaf2fbd9f0b77b132 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:12.543375 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-e9309f2844e444faaf2fbd9f0b77b132 on tablet e9309f2844e444faaf2fbd9f0b77b132 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:12.713370 16095 raft_consensus.cc:1203] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:12.772184 16095 raft_consensus.cc:1203] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:12.923269 16411 raft_consensus.cc:1050] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:12.925741 16411 consensus_queue.cc:237] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:12.935796 16096 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:12.937191 16412 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:12.939926 15512 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:12.943449 16412 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:12.948920 15356 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:12.950858 16412 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:12.969398 16430 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:12.980237 15506 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:12.977617 15361 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.013659 15260 catalog_manager.cc:5495] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.030422 16095 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.046247 16096 raft_consensus.cc:1203] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:13.092063 15435 consensus_queue.cc:237] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:13.104843 16096 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:13.106678 15506 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:13.106568 16412 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:13.111974 16430 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:13.119920 16445 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.121600 15506 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.129268 16096 raft_consensus.cc:2932] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.152654 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5af50e35934e4cd3960c886105fb34b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:13.153990 15258 catalog_manager.cc:5495] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.174121 16406 raft_consensus.cc:1050] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:13.176117 16406 consensus_queue.cc:237] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:13.177879 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 5af50e35934e4cd3960c886105fb34b7 with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:13.179678 16449 tablet_replica.cc:330] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:13.180559 16449 raft_consensus.cc:2229] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:13.182828 16096 raft_consensus.cc:1261] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.183452 16449 raft_consensus.cc:2258] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:13.184485 16202 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:13.185477 15506 raft_consensus.cc:1261] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.187880 15439 raft_consensus.cc:1261] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.188532 16202 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:13.191830 16449 ts_tablet_manager.cc:1905] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:13.189396 16451 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260929 11:36:13.206240 16202 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.210330 15506 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.213452 16449 ts_tablet_manager.cc:1918] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:13.213889 16449 log.cc:1196] T 5af50e35934e4cd3960c886105fb34b7 P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/5af50e35934e4cd3960c886105fb34b7
I20260929 11:36:13.215646 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 5af50e35934e4cd3960c886105fb34b7 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:13.215790 15435 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.223510 15258 catalog_manager.cc:5495] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:13.243360 16430 raft_consensus.cc:1050] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:13.246201 16430 consensus_queue.cc:237] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:13.230952 16096 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.263545 15356 consensus_queue.cc:237] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:13.269402 15506 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.270167 15361 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.271195 16096 raft_consensus.cc:1261] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:13.270965 16411 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:13.272760 16095 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.273932 16411 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:13.274215 15435 raft_consensus.cc:1261] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:13.275527 16430 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:13.278034 16406 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:13.281833 16402 consensus_queue.cc:1035] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:13.295688 16202 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.298921 16095 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.309641 15435 raft_consensus.cc:2932] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.313611 16445 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.317298 16096 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.329161 15258 catalog_manager.cc:5495] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.359256 15512 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.366415 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 85688ae966734650b9fca8130f2feb8c with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:13.374194 15259 catalog_manager.cc:5495] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.381102 15356 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.407409 16462 tablet_replica.cc:330] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:13.414288 16462 raft_consensus.cc:2229] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260929 11:36:13.416177 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 87526.2us
W20260929 11:36:13.417285 15405 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39689, user_credentials={real_user=slave}} blocked reactor thread for 73400.5us
I20260929 11:36:13.417544 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 85688ae966734650b9fca8130f2feb8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:13.417557 16462 raft_consensus.cc:2258] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:13.427119 16462 ts_tablet_manager.cc:1905] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:13.445281 15438 consensus_queue.cc:237] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:13.454213 15356 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:13.458645 16411 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:13.459026 16462 ts_tablet_manager.cc:1918] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:13.459615 16462 log.cc:1196] T 85688ae966734650b9fca8130f2feb8c P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/85688ae966734650b9fca8130f2feb8c
I20260929 11:36:13.461463 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 85688ae966734650b9fca8130f2feb8c (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:13.464970 16096 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:13.466223 16430 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:13.466061 16411 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.467198 15356 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.471606 16096 raft_consensus.cc:2932] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.475023 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet ae0c7572ce72494f9c505c54480619fa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:13.486969 16451 raft_consensus.cc:1050] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:13.487111 15258 catalog_manager.cc:5495] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.489421 16451 consensus_queue.cc:237] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:13.503255 16096 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.506142 16459 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:13.508879 15509 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.508946 15435 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:13.512357 16202 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:13.515070 16202 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:13.530531 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet ae0c7572ce72494f9c505c54480619fa with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:13.531471 16462 tablet_replica.cc:330] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:13.532459 16462 raft_consensus.cc:2229] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:13.533051 16462 raft_consensus.cc:2258] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:13.536152 16462 ts_tablet_manager.cc:1905] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:13.540007 16451 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.541507 16096 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.557850 15259 catalog_manager.cc:5495] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.567085 15509 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.567854 15435 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.585191 15361 consensus_queue.cc:237] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:13.590353 16097 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:13.592269 16459 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:13.595523 15509 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:13.598476 16406 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:13.598888 16462 ts_tablet_manager.cc:1918] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:13.599354 16462 log.cc:1196] T ae0c7572ce72494f9c505c54480619fa P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/ae0c7572ce72494f9c505c54480619fa
I20260929 11:36:13.599772 16202 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.600911 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet ae0c7572ce72494f9c505c54480619fa (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:13.601608 16097 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.603000 15509 raft_consensus.cc:2932] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.612385 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e9309f2844e444faaf2fbd9f0b77b132 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:13.619819 15258 catalog_manager.cc:5495] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:13.634888 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet e9309f2844e444faaf2fbd9f0b77b132 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:13.636581 16468 tablet_replica.cc:330] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:13.637624 16468 raft_consensus.cc:2229] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:13.638422 16468 raft_consensus.cc:2258] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:13.641795 16468 ts_tablet_manager.cc:1905] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:13.655278 16468 ts_tablet_manager.cc:1918] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:13.655625 16468 log.cc:1196] T e9309f2844e444faaf2fbd9f0b77b132 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/e9309f2844e444faaf2fbd9f0b77b132
I20260929 11:36:13.657063 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet e9309f2844e444faaf2fbd9f0b77b132 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:14.700534 15435 consensus_queue.cc:237] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:14.708949 15512 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:14.709509 15405 consensus_peers.cc:487] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f969b15260af489b992eeca4080e55ed. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:14.710695 15356 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:14.710743 16445 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:14.712168 16430 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:14.719161 16445 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.720813 15512 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.728053 15356 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.746327 15509 consensus_queue.cc:237] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:14.749033 15261 catalog_manager.cc:5495] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:14.763055 15479 consensus_peers.cc:487] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b4452619bf4405caf985d1675be1408. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:14.765552 15435 raft_consensus.cc:1261] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:14.766553 15356 raft_consensus.cc:1261] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:14.767827 16404 consensus_queue.cc:1035] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:14.768822 16464 consensus_queue.cc:1035] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:14.778615 16464 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.780128 15435 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.784397 15356 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.798236 15509 consensus_queue.cc:237] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:14.799878 15259 catalog_manager.cc:5495] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:14.833982 15439 raft_consensus.cc:1261] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:14.836349 16404 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260929 11:36:14.838532 15479 consensus_peers.cc:487] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f281c33521294dbdac740fec2f2b0b51. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:14.845988 15356 raft_consensus.cc:1261] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:14.847997 16464 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.849138 16482 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:14.852430 15435 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.854302 15356 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.867237 15261 catalog_manager.cc:5495] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:14.869505 15356 consensus_queue.cc:237] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
W20260929 11:36:14.877278 15330 consensus_peers.cc:487] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26f6df46badd473ab3b02a550aa18cc2. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:14.878362 15509 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:14.880772 16460 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:14.885703 15435 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:14.887573 16202 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:14.898120 16459 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.903635 15435 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.905390 15512 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:14.922104 15258 catalog_manager.cc:5495] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:15.301589 16488 ts_tablet_manager.cc:927] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:15.304982 16488 tablet_copy_client.cc:316] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:15.306957 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet f969b15260af489b992eeca4080e55ed from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:15.307538 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet f969b15260af489b992eeca4080e55ed from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-f969b15260af489b992eeca4080e55ed
I20260929 11:36:15.315716 15449 tablet_copy_source_session.cc:205] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:15.319478 16488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f969b15260af489b992eeca4080e55ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:15.330649 16490 ts_tablet_manager.cc:927] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:15.337316 16488 tablet_copy_client.cc:791] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:15.338223 16488 tablet_copy_client.cc:655] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:15.350123 16488 tablet_copy_client.cc:531] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:15.364761 16488 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:15.367604 16492 ts_tablet_manager.cc:927] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:15.368206 16490 tablet_copy_client.cc:316] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:15.370314 15523 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet f281c33521294dbdac740fec2f2b0b51 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:15.370831 15523 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet f281c33521294dbdac740fec2f2b0b51 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-f281c33521294dbdac740fec2f2b0b51
I20260929 11:36:15.372501 16492 tablet_copy_client.cc:316] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:15.376176 15522 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet 2b4452619bf4405caf985d1675be1408 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:15.376751 15522 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet 2b4452619bf4405caf985d1675be1408 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-2b4452619bf4405caf985d1675be1408
I20260929 11:36:15.381083 15523 tablet_copy_source_session.cc:205] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:15.385143 15522 tablet_copy_source_session.cc:205] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:15.388625 16492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4452619bf4405caf985d1675be1408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:15.389267 16490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f281c33521294dbdac740fec2f2b0b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:15.406307 16490 tablet_copy_client.cc:791] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:15.407094 16490 tablet_copy_client.cc:655] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:15.412303 16490 tablet_copy_client.cc:531] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:15.412432 16492 tablet_copy_client.cc:791] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:15.412801 16488 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:15.413213 16492 tablet_copy_client.cc:655] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:15.413750 16488 tablet_bootstrap.cc:492] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:15.414965 16488 ts_tablet_manager.cc:1397] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.050s user 0.018s sys 0.004s
I20260929 11:36:15.418154 16488 raft_consensus.cc:348] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:15.419027 16488 raft_consensus.cc:729] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:15.419673 16488 consensus_queue.cc:260] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:15.424536 16490 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:15.433531 16492 tablet_copy_client.cc:531] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:15.434342 16488 ts_tablet_manager.cc:1428] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.019s user 0.008s sys 0.012s
I20260929 11:36:15.436533 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-f969b15260af489b992eeca4080e55ed received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:15.436944 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-f969b15260af489b992eeca4080e55ed on tablet f969b15260af489b992eeca4080e55ed with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:15.453434 16492 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:15.468158 16490 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:15.469012 16490 tablet_bootstrap.cc:492] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:15.469658 16490 ts_tablet_manager.cc:1397] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.045s user 0.023s sys 0.018s
I20260929 11:36:15.472292 16490 raft_consensus.cc:348] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:15.473107 16490 raft_consensus.cc:729] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:15.473677 16490 consensus_queue.cc:260] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:15.476631 16488 ts_tablet_manager.cc:927] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:15.478030 16490 ts_tablet_manager.cc:1428] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.008s user 0.003s sys 0.005s
I20260929 11:36:15.480403 15522 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-f281c33521294dbdac740fec2f2b0b51 received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:15.483588 15522 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-f281c33521294dbdac740fec2f2b0b51 on tablet f281c33521294dbdac740fec2f2b0b51 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:15.489861 16488 tablet_copy_client.cc:316] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:15.491845 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 26f6df46badd473ab3b02a550aa18cc2 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:15.493435 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 26f6df46badd473ab3b02a550aa18cc2 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-26f6df46badd473ab3b02a550aa18cc2
I20260929 11:36:15.497820 16492 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:15.498755 16492 tablet_bootstrap.cc:492] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:15.499394 16492 ts_tablet_manager.cc:1397] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.046s user 0.020s sys 0.004s
I20260929 11:36:15.502152 15374 tablet_copy_source_session.cc:205] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:15.505403 16488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26f6df46badd473ab3b02a550aa18cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:15.505050 16492 raft_consensus.cc:348] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:15.505973 16492 raft_consensus.cc:729] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:15.506615 16492 consensus_queue.cc:260] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:15.509418 16492 ts_tablet_manager.cc:1428] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260929 11:36:15.510979 15522 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-2b4452619bf4405caf985d1675be1408 received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:15.511369 15522 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-2b4452619bf4405caf985d1675be1408 on tablet 2b4452619bf4405caf985d1675be1408 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:15.523257 16488 tablet_copy_client.cc:791] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:15.523886 16488 tablet_copy_client.cc:655] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:15.529213 16488 tablet_copy_client.cc:531] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:15.538364 16488 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:15.559639 16488 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:15.560582 16488 tablet_bootstrap.cc:492] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:15.561205 16488 ts_tablet_manager.cc:1397] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.023s user 0.014s sys 0.008s
I20260929 11:36:15.564282 16488 raft_consensus.cc:348] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:15.565156 16488 raft_consensus.cc:729] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:15.565752 16488 consensus_queue.cc:260] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:15.568372 16488 ts_tablet_manager.cc:1428] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260929 11:36:15.570343 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-26f6df46badd473ab3b02a550aa18cc2 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:15.570822 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-26f6df46badd473ab3b02a550aa18cc2 on tablet 26f6df46badd473ab3b02a550aa18cc2 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:15.777591 16097 raft_consensus.cc:1203] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:15.791932 16097 raft_consensus.cc:1203] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:15.938292 16097 raft_consensus.cc:1203] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:16.089484 16097 raft_consensus.cc:1203] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:16.180691 16404 raft_consensus.cc:1050] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:16.182933 16404 consensus_queue.cc:237] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:16.208989 16097 raft_consensus.cc:1261] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.209789 15361 raft_consensus.cc:1261] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.210498 16482 consensus_queue.cc:1035] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.210532 15438 raft_consensus.cc:1261] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.212144 16502 consensus_queue.cc:1035] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.213762 16464 consensus_queue.cc:1035] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.239776 16464 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.244958 15361 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.249986 15435 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.252444 16097 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.259799 15259 catalog_manager.cc:5495] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:16.287683 15512 consensus_queue.cc:237] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:16.293295 16097 raft_consensus.cc:1261] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:16.293852 15435 raft_consensus.cc:1261] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:16.295560 16464 consensus_queue.cc:1035] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:16.297329 16482 consensus_queue.cc:1035] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:16.309653 16482 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.311650 16096 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.321377 15435 raft_consensus.cc:2932] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.327227 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 2b4452619bf4405caf985d1675be1408 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:16.329671 16445 raft_consensus.cc:1050] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:16.332173 16445 consensus_queue.cc:237] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:16.338415 15261 catalog_manager.cc:5495] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:16.345813 16097 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.346372 15512 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.347791 16501 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:16.350282 16501 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.374095 16445 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.376052 15510 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.385574 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b4452619bf4405caf985d1675be1408 with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
W20260929 11:36:16.401566 15402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 58518.4us
I20260929 11:36:16.403543 15361 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.405652 16430 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.406822 16097 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.413154 15260 catalog_manager.cc:5495] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:16.434424 16515 tablet_replica.cc:330] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:16.435645 16515 raft_consensus.cc:2229] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:16.436466 16515 raft_consensus.cc:2258] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:16.435488 15361 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.439286 15435 consensus_queue.cc:237] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:16.441766 16515 ts_tablet_manager.cc:1905] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:16.446419 16097 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:16.446745 15510 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:16.448498 16512 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:16.450856 16430 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:16.459615 16445 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.464717 15510 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.466744 16515 ts_tablet_manager.cc:1918] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:16.467276 16515 log.cc:1196] T 2b4452619bf4405caf985d1675be1408 P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/2b4452619bf4405caf985d1675be1408
I20260929 11:36:16.467799 16096 raft_consensus.cc:2932] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.469509 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 2b4452619bf4405caf985d1675be1408 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:16.478237 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f969b15260af489b992eeca4080e55ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:16.483712 15260 catalog_manager.cc:5495] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.494419 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet f969b15260af489b992eeca4080e55ed with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:16.495462 16515 tablet_replica.cc:330] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:16.496546 16515 raft_consensus.cc:2229] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:16.497224 16515 raft_consensus.cc:2258] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:16.500830 16515 ts_tablet_manager.cc:1905] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:16.516453 16515 ts_tablet_manager.cc:1918] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:16.516844 16515 log.cc:1196] T f969b15260af489b992eeca4080e55ed P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/f969b15260af489b992eeca4080e55ed
I20260929 11:36:16.518225 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet f969b15260af489b992eeca4080e55ed (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:16.523250 16464 raft_consensus.cc:1050] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:16.525595 16464 consensus_queue.cc:237] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:16.531203 15439 raft_consensus.cc:1261] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.533165 15361 raft_consensus.cc:1261] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.534037 16464 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.534979 16482 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.535594 16096 raft_consensus.cc:1261] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.537607 16404 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.563194 16482 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.565876 16096 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.568276 15361 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.582202 15439 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.589408 15260 catalog_manager.cc:5495] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.616135 15510 consensus_queue.cc:237] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:16.621043 16096 raft_consensus.cc:1261] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:16.622637 16502 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:16.627789 15359 raft_consensus.cc:1261] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:16.629179 16404 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.630439 16502 consensus_queue.cc:1035] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:16.631278 16096 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.640216 15359 raft_consensus.cc:2932] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.641705 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f281c33521294dbdac740fec2f2b0b51 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:16.647248 15260 catalog_manager.cc:5495] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.663348 16460 raft_consensus.cc:1050] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:16.665210 16460 consensus_queue.cc:237] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:16.674588 16097 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.675001 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet f281c33521294dbdac740fec2f2b0b51 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:16.677103 16500 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:16.689409 16523 tablet_replica.cc:330] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:16.695779 16523 raft_consensus.cc:2229] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:16.696635 16523 raft_consensus.cc:2258] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:16.699612 15512 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.700466 16523 ts_tablet_manager.cc:1905] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:16.701892 15435 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:16.702957 16500 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.706400 16500 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:16.717097 16459 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.723934 16523 ts_tablet_manager.cc:1918] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:16.722952 15510 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.724448 16523 log.cc:1196] T f281c33521294dbdac740fec2f2b0b51 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/f281c33521294dbdac740fec2f2b0b51
I20260929 11:36:16.726085 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet f281c33521294dbdac740fec2f2b0b51 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:16.737287 16097 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.740307 15435 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.742323 15259 catalog_manager.cc:5495] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:16.778258 15361 consensus_queue.cc:237] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:16.783412 16097 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:16.784312 15435 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:16.786154 16460 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:16.789150 16460 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:16.792951 16522 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.798373 15435 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.804857 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 26f6df46badd473ab3b02a550aa18cc2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:16.804860 16097 raft_consensus.cc:2932] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:16.813956 15261 catalog_manager.cc:5495] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:16.824935 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 26f6df46badd473ab3b02a550aa18cc2 with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:16.829882 16527 tablet_replica.cc:330] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:16.830705 16527 raft_consensus.cc:2229] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:16.831274 16527 raft_consensus.cc:2258] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:16.834964 16527 ts_tablet_manager.cc:1905] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:16.848923 16527 ts_tablet_manager.cc:1918] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:16.849340 16527 log.cc:1196] T 26f6df46badd473ab3b02a550aa18cc2 P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/26f6df46badd473ab3b02a550aa18cc2
I20260929 11:36:16.851027 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 26f6df46badd473ab3b02a550aa18cc2 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:17.884061 15439 consensus_queue.cc:237] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
W20260929 11:36:17.890471 15405 consensus_peers.cc:487] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7272ea4499be458a8d957a25b7d508bb. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:17.890899 15512 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:17.890939 15361 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:17.892546 16501 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:17.893298 16512 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:17.900821 16512 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:17.903652 15361 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:17.902525 15512 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:17.916139 15510 consensus_queue.cc:237] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:17.922508 15260 catalog_manager.cc:5495] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:17.940546 15356 raft_consensus.cc:1261] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:17.940915 15479 consensus_peers.cc:487] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 290cd2101f81472384670fdea31eaaf6. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:17.942456 16464 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:17.944113 15439 raft_consensus.cc:1261] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:17.948911 16464 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:17.971560 16404 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:17.978730 15361 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.008955 15439 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.010448 15356 consensus_queue.cc:237] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.042353 15261 catalog_manager.cc:5495] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:18.050559 15330 consensus_peers.cc:487] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18064e092cec4a5fbc144b23fcd5abaf. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:18.051111 15435 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:18.052546 16528 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:18.051113 15512 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:18.056308 16528 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:18.063221 16522 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.068733 15439 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.071065 15510 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.083392 15439 consensus_queue.cc:237] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.084301 15260 catalog_manager.cc:5495] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.092674 15512 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260929 11:36:18.093083 15405 consensus_peers.cc:487] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2454e1272e994181a08e49e54473af7a. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:18.093169 15356 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:18.094054 16533 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:18.096037 16534 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:18.110322 16512 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.111748 15510 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.112527 15361 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.128924 15261 catalog_manager.cc:5495] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:18.157148 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:18.225945 15361 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:18.226524 15361 raft_consensus.cc:595] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.229665 15361 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:18.230242 15361 raft_consensus.cc:595] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.251078 15435 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:18.251683 15435 raft_consensus.cc:595] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.268105 15510 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:55996
I20260929 11:36:18.268699 15510 raft_consensus.cc:595] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.271173 15435 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:18.271621 15435 raft_consensus.cc:595] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS adf4734bb02e4108b00fabc552483a18
I20260929 11:36:18.273940 15435 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:18.274374 15435 raft_consensus.cc:595] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.275252 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260929 11:36:18.276356 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:18.276973 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:18.304795 16532 raft_consensus.cc:979] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:18.305344 16534 raft_consensus.cc:1067] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:18.306859 15509 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:47196
I20260929 11:36:18.307391 15509 raft_consensus.cc:482] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:18.307722 15509 raft_consensus.cc:3037] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.314364 15509 raft_consensus.cc:504] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.317557 15509 leader_election.cc:288] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:18.318423 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:18.319113 15361 raft_consensus.cc:3037] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.319896 15435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7272ea4499be458a8d957a25b7d508bb" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:18.320504 15435 raft_consensus.cc:3032] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:18.320801 15435 raft_consensus.cc:729] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:18.321822 15435 consensus_queue.cc:260] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.323268 15435 raft_consensus.cc:3037] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.323585 16557 ts_tablet_manager.cc:927] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:18.325716 16557 tablet_copy_client.cc:316] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:18.327229 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 7272ea4499be458a8d957a25b7d508bb from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:18.327724 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 7272ea4499be458a8d957a25b7d508bb from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-7272ea4499be458a8d957a25b7d508bb
I20260929 11:36:18.329861 15361 raft_consensus.cc:2454] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:18.331947 15435 raft_consensus.cc:2454] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:18.332417 15476 leader_election.cc:302] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:18.333166 16541 raft_consensus.cc:2781] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:18.333644 16541 raft_consensus.cc:686] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:18.334514 16541 consensus_queue.cc:237] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.335654 15449 tablet_copy_source_session.cc:205] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:18.336216 16528 raft_consensus.cc:979] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.338244 16528 raft_consensus.cc:1067] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.341915 16096 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48220
I20260929 11:36:18.342175 16557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7272ea4499be458a8d957a25b7d508bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:18.342451 16096 raft_consensus.cc:482] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:18.342792 16096 raft_consensus.cc:3037] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.346689 15259 catalog_manager.cc:5495] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 2 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:18.356851 16557 tablet_copy_client.cc:791] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:18.357425 16557 tablet_copy_client.cc:655] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:18.350828 16096 raft_consensus.cc:504] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.364410 16557 tablet_copy_client.cc:531] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:18.367810 16541 raft_consensus.cc:979] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.367851 16096 leader_election.cc:288] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:18.368341 16404 raft_consensus.cc:1067] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.369055 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:18.368934 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133f7cd27af34f7ebc89e90b65170522" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:18.369748 15361 raft_consensus.cc:3032] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:18.369783 15509 raft_consensus.cc:3037] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.369937 16097 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48232
I20260929 11:36:18.370275 15361 raft_consensus.cc:729] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:18.370527 16097 raft_consensus.cc:482] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:18.370852 16097 raft_consensus.cc:3037] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.371241 15361 consensus_queue.cc:260] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.372378 15361 raft_consensus.cc:3037] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.375125 16557 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:18.376493 15509 raft_consensus.cc:2454] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.377761 16062 leader_election.cc:302] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf4734bb02e4108b00fabc552483a18, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:18.378289 15361 raft_consensus.cc:2454] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.379302 16097 raft_consensus.cc:504] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.381239 16097 leader_election.cc:288] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:18.381841 16559 raft_consensus.cc:2781] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:18.385304 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:18.385594 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69f25939e19c461ab830dd08f6e6b790" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:18.385924 15438 raft_consensus.cc:3037] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.386251 15509 raft_consensus.cc:3032] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:18.386562 15509 raft_consensus.cc:729] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:18.398193 15438 raft_consensus.cc:2454] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.403275 16062 leader_election.cc:302] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:18.387320 15509 consensus_queue.cc:260] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.406103 15509 raft_consensus.cc:3037] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.410789 16557 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:18.411692 16557 tablet_bootstrap.cc:492] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:18.412400 16557 ts_tablet_manager.cc:1397] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.037s user 0.024s sys 0.005s
I20260929 11:36:18.413932 15509 raft_consensus.cc:2454] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.415356 16557 raft_consensus.cc:348] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.416739 16557 raft_consensus.cc:729] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:18.417644 16557 consensus_queue.cc:260] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.422907 16559 raft_consensus.cc:686] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:18.424729 16563 raft_consensus.cc:2781] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:18.424224 16559 consensus_queue.cc:237] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.425241 16563 raft_consensus.cc:686] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:18.425684 16557 ts_tablet_manager.cc:1428] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.013s user 0.010s sys 0.000s
I20260929 11:36:18.426229 16563 consensus_queue.cc:237] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.426951 16534 raft_consensus.cc:979] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.427417 16534 raft_consensus.cc:1067] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.430706 16097 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48212
I20260929 11:36:18.431675 16097 raft_consensus.cc:482] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:18.432011 16097 raft_consensus.cc:3037] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.439419 16097 raft_consensus.cc:504] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.443454 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:18.444025 15361 raft_consensus.cc:3037] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.449638 16528 raft_consensus.cc:979] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.450323 16528 raft_consensus.cc:1067] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.452379 15361 raft_consensus.cc:2454] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.452540 16096 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48220
I20260929 11:36:18.453385 16096 raft_consensus.cc:482] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:18.453648 16060 leader_election.cc:302] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:18.453816 16096 raft_consensus.cc:3037] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.454818 16097 leader_election.cc:288] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
W20260929 11:36:18.456629 16062 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 53457.3us
I20260929 11:36:18.458412 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-7272ea4499be458a8d957a25b7d508bb received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:18.458847 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-7272ea4499be458a8d957a25b7d508bb on tablet 7272ea4499be458a8d957a25b7d508bb with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.459323 16562 raft_consensus.cc:2781] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:18.459897 16562 raft_consensus.cc:686] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:18.460793 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1839f2d147ac4c7a91bafb727fb103cd" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:18.461421 15438 raft_consensus.cc:3032] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:18.461758 15438 raft_consensus.cc:729] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:18.461191 16562 consensus_queue.cc:237] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.462430 15438 consensus_queue.cc:260] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.463460 15438 raft_consensus.cc:3037] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.467715 16096 raft_consensus.cc:504] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.474056 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:18.474630 15361 raft_consensus.cc:3032] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:18.476949 15361 raft_consensus.cc:729] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:18.478139 16557 ts_tablet_manager.cc:927] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:18.478255 15259 catalog_manager.cc:5495] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:18.479010 15361 consensus_queue.cc:260] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.480077 15361 raft_consensus.cc:3037] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.480194 15259 catalog_manager.cc:5495] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from adf4734bb02e4108b00fabc552483a18 (127.13.221.195) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:18.482116 15438 raft_consensus.cc:2454] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.483100 16096 leader_election.cc:288] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:18.489893 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082d372bd5004d6e90543b4fe1ba1b88" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:18.490495 15510 raft_consensus.cc:3037] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.498354 15361 raft_consensus.cc:2454] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.499972 16060 leader_election.cc:302] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:18.501124 16562 raft_consensus.cc:2781] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:18.503713 15510 raft_consensus.cc:2454] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.505498 16557 tablet_copy_client.cc:316] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:18.504930 15260 catalog_manager.cc:5495] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:18.501837 16562 raft_consensus.cc:686] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:18.507397 16562 consensus_queue.cc:237] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.507912 15522 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet 290cd2101f81472384670fdea31eaaf6 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:18.508478 15522 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet 290cd2101f81472384670fdea31eaaf6 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-290cd2101f81472384670fdea31eaaf6
I20260929 11:36:18.518831 15522 tablet_copy_source_session.cc:205] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:18.524019 16557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 290cd2101f81472384670fdea31eaaf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:18.538466 15260 catalog_manager.cc:5495] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:18.540959 16569 ts_tablet_manager.cc:927] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:18.549434 16557 tablet_copy_client.cc:791] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:18.550122 16557 tablet_copy_client.cc:655] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:18.559986 16557 tablet_copy_client.cc:531] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:18.561890 16570 ts_tablet_manager.cc:927] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:18.565434 16569 tablet_copy_client.cc:316] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:18.567076 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 18064e092cec4a5fbc144b23fcd5abaf from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:18.567804 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 18064e092cec4a5fbc144b23fcd5abaf from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-18064e092cec4a5fbc144b23fcd5abaf
I20260929 11:36:18.569564 16570 tablet_copy_client.cc:316] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:18.571278 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 2454e1272e994181a08e49e54473af7a from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:18.571789 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 2454e1272e994181a08e49e54473af7a from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-2454e1272e994181a08e49e54473af7a
I20260929 11:36:18.574059 16557 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:18.580053 15449 tablet_copy_source_session.cc:205] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:18.580039 15374 tablet_copy_source_session.cc:205] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:18.583779 16570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2454e1272e994181a08e49e54473af7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:18.584456 16569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18064e092cec4a5fbc144b23fcd5abaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:18.601167 16569 tablet_copy_client.cc:791] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:18.601786 16569 tablet_copy_client.cc:655] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:18.611492 16570 tablet_copy_client.cc:791] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:18.613364 16569 tablet_copy_client.cc:531] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:18.613720 16512 raft_consensus.cc:979] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.614184 16512 raft_consensus.cc:1067] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:18.617944 16557 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:18.618371 16570 tablet_copy_client.cc:655] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:18.618849 16557 tablet_bootstrap.cc:492] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:18.619618 16557 ts_tablet_manager.cc:1397] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.046s user 0.032s sys 0.006s
I20260929 11:36:18.622299 16557 raft_consensus.cc:348] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.623245 16557 raft_consensus.cc:729] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:18.623791 16569 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:18.623967 16557 consensus_queue.cc:260] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.625406 16570 tablet_copy_client.cc:531] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:18.619879 16097 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48212
I20260929 11:36:18.626842 16557 ts_tablet_manager.cc:1428] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.007s user 0.006s sys 0.004s
I20260929 11:36:18.626953 16097 raft_consensus.cc:482] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:18.627408 16097 raft_consensus.cc:3037] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.630995 15522 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-290cd2101f81472384670fdea31eaaf6 received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:18.631448 15522 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-290cd2101f81472384670fdea31eaaf6 on tablet 290cd2101f81472384670fdea31eaaf6 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.650688 16097 raft_consensus.cc:504] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.651477 16570 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:18.653806 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:18.654623 15433 raft_consensus.cc:3032] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:18.654978 15433 raft_consensus.cc:729] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:18.655175 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86dbbec4ace04094a09c85a3ad15d9fb" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:18.655730 15509 raft_consensus.cc:3037] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.655917 15433 consensus_queue.cc:260] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.657265 15433 raft_consensus.cc:3037] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:18.664225 16097 leader_election.cc:288] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:18.669121 15509 raft_consensus.cc:2454] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.670070 15433 raft_consensus.cc:2454] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:18.670202 16062 leader_election.cc:302] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf4734bb02e4108b00fabc552483a18, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:18.680264 16569 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:18.680976 16562 raft_consensus.cc:2781] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:18.681258 16569 tablet_bootstrap.cc:492] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:18.681457 16562 raft_consensus.cc:686] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:18.681947 16569 ts_tablet_manager.cc:1397] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.058s user 0.014s sys 0.010s
I20260929 11:36:18.682402 16562 consensus_queue.cc:237] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.685335 16569 raft_consensus.cc:348] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.686223 16569 raft_consensus.cc:729] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:18.686834 16569 consensus_queue.cc:260] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.690930 16569 ts_tablet_manager.cc:1428] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260929 11:36:18.692648 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-18064e092cec4a5fbc144b23fcd5abaf received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:18.693029 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-18064e092cec4a5fbc144b23fcd5abaf on tablet 18064e092cec4a5fbc144b23fcd5abaf with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.696270 16570 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:18.697288 16570 tablet_bootstrap.cc:492] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:18.697942 16570 ts_tablet_manager.cc:1397] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.047s user 0.021s sys 0.000s
I20260929 11:36:18.700637 16570 raft_consensus.cc:348] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.701493 16570 raft_consensus.cc:729] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:18.702117 16570 consensus_queue.cc:260] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:18.702296 15260 catalog_manager.cc:5495] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:18.704537 16570 ts_tablet_manager.cc:1428] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260929 11:36:18.706336 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-2454e1272e994181a08e49e54473af7a received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:18.706758 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-2454e1272e994181a08e49e54473af7a on tablet 2454e1272e994181a08e49e54473af7a with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:18.761880 15361 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:18.763041 16464 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:18.770823 16097 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:18.773008 15433 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:18.772871 16544 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:18.775391 16464 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:18.813931 16544 raft_consensus.cc:1050] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:18.817236 16544 consensus_queue.cc:237] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.826620 15438 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:18.826786 16097 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:18.828058 16541 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:18.828883 16464 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:18.837633 15356 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:18.838964 16541 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:18.841377 16464 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.843374 16097 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.843647 15356 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.852648 15433 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.853655 15438 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:18.855521 16562 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:18.864152 15509 raft_consensus.cc:1261] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:18.867219 16562 consensus_queue.cc:1035] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:18.867799 15259 catalog_manager.cc:5495] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.898164 15510 consensus_queue.cc:237] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:18.904366 15433 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:18.905970 16562 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:18.912133 16097 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:18.914646 16404 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:18.916206 15438 raft_consensus.cc:1261] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:18.917413 16404 consensus_queue.cc:1035] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:18.924746 16544 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.927217 15438 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.929379 16097 raft_consensus.cc:2932] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.934834 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7272ea4499be458a8d957a25b7d508bb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:18.948632 15356 raft_consensus.cc:1261] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:18.954819 16559 consensus_queue.cc:1035] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:18.955667 15509 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:18.958585 16562 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:18.972172 16097 raft_consensus.cc:1203] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20260929 11:36:18.975751 15259 catalog_manager.cc:5495] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 2 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:18.992363 15356 raft_consensus.cc:1261] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:18.994117 16559 consensus_queue.cc:1035] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:19.004292 15360 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:19.005856 16559 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:19.016355 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 7272ea4499be458a8d957a25b7d508bb with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:19.021247 15512 raft_consensus.cc:1261] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:19.024220 16559 consensus_queue.cc:1035] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:19.035341 16589 tablet_replica.cc:330] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:19.036873 16589 raft_consensus.cc:2229] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:19.037777 16589 raft_consensus.cc:2258] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:19.049685 16589 ts_tablet_manager.cc:1905] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:19.081875 16097 raft_consensus.cc:1203] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:19.085250 16589 ts_tablet_manager.cc:1918] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260929 11:36:19.085834 16589 log.cc:1196] T 7272ea4499be458a8d957a25b7d508bb P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/7272ea4499be458a8d957a25b7d508bb
I20260929 11:36:19.102491 16097 raft_consensus.cc:1203] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:19.109784 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 7272ea4499be458a8d957a25b7d508bb (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:19.184908 15512 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:19.186086 16559 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:19.195644 15438 raft_consensus.cc:1261] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:19.196933 16559 consensus_queue.cc:1035] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:19.322618 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:19.365420 15360 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:19.366076 15360 raft_consensus.cc:595] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:19.368822 15360 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:19.369386 15360 raft_consensus.cc:595] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:19.371883 15360 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:19.372480 15360 raft_consensus.cc:595] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:19.374723 15360 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:19.375250 15360 raft_consensus.cc:595] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:19.379293 15356 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:19.379760 15356 raft_consensus.cc:595] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:19.381887 15512 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8351697a268a4337843da29ee5afac70"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:55996
I20260929 11:36:19.382405 15512 raft_consensus.cc:595] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:19.383481 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260929 11:36:19.383966 16460 raft_consensus.cc:979] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:19.384444 16522 raft_consensus.cc:1067] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:19.385231 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:19.386029 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:19.385995 15438 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:19.386729 15438 raft_consensus.cc:482] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:19.387084 15438 raft_consensus.cc:3037] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.388266 16512 raft_consensus.cc:1050] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:19.398242 16512 consensus_queue.cc:237] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.404870 15438 raft_consensus.cc:504] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.410810 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:19.411420 15356 raft_consensus.cc:3032] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:19.411710 15356 raft_consensus.cc:729] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:19.412432 15356 consensus_queue.cc:260] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.413169 16097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293283a1ffae44dfb01a86f8eaf344f0" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:19.414017 16097 raft_consensus.cc:3037] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.413489 15356 raft_consensus.cc:3037] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.420636 15438 leader_election.cc:288] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:19.430593 16096 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:19.431365 15510 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:19.432029 16533 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:19.433230 16097 raft_consensus.cc:2454] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:19.435541 15356 raft_consensus.cc:2454] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:19.440395 15405 leader_election.cc:302] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:19.441699 16512 raft_consensus.cc:2781] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:19.442212 16512 raft_consensus.cc:686] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:19.442466 16532 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:19.443109 16512 consensus_queue.cc:237] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.451390 15356 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:19.458043 16532 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:19.469470 16594 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.471071 15259 catalog_manager.cc:5495] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:19.477525 15509 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.482910 16547 raft_consensus.cc:1050] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:19.485401 16547 consensus_queue.cc:237] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.496826 16096 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:19.497020 16097 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.501332 15512 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:19.502875 16547 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:19.507090 15438 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:19.511641 16547 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:19.518194 16522 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:19.522109 15360 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.528650 15261 catalog_manager.cc:5495] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:19.534929 16522 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.537016 15510 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.539496 16097 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.560089 16547 raft_consensus.cc:979] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:19.561286 16460 raft_consensus.cc:1067] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:19.564625 15433 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.567111 16096 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48220
I20260929 11:36:19.567870 16096 raft_consensus.cc:482] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:19.568307 16096 raft_consensus.cc:3037] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.592303 15433 consensus_queue.cc:237] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.580044 16096 raft_consensus.cc:504] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.599464 15260 catalog_manager.cc:5495] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.614385 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:19.614945 15359 raft_consensus.cc:3032] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:19.615142 15359 raft_consensus.cc:729] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:19.615767 15359 consensus_queue.cc:260] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.617154 16095 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:19.617717 15359 raft_consensus.cc:3037] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.618721 16532 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:19.626701 16464 raft_consensus.cc:1050] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:19.626618 16596 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.629015 16464 consensus_queue.cc:237] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.628273 16094 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.633772 15359 raft_consensus.cc:2454] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:19.635275 16060 leader_election.cc:302] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:19.636132 16559 raft_consensus.cc:2781] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:19.636660 16559 raft_consensus.cc:686] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:19.639573 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 2454e1272e994181a08e49e54473af7a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:19.637594 15356 consensus_queue.cc:237] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.641657 16559 consensus_queue.cc:237] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.645685 16096 leader_election.cc:288] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:19.640285 15360 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:19.647604 15439 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:19.647601 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06a45ce12d33457f8e8a937ebe912eff" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:19.648950 15433 raft_consensus.cc:3037] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.650074 16522 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:19.651463 16532 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:19.656783 15361 raft_consensus.cc:2932] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.659268 16097 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:19.660441 16522 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:19.662276 15261 catalog_manager.cc:5495] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:19.668602 15259 catalog_manager.cc:5495] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:19.669014 16547 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.670993 15439 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.700933 15433 raft_consensus.cc:2454] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:19.703218 16097 raft_consensus.cc:2932] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.716576 16097 raft_consensus.cc:1261] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:19.731035 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 2454e1272e994181a08e49e54473af7a with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:19.730505 16464 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260929 11:36:19.723790 16547 raft_consensus.cc:979] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:19.740975 16460 raft_consensus.cc:1067] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:19.744509 16095 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48220
I20260929 11:36:19.745255 16095 raft_consensus.cc:482] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:19.745682 16095 raft_consensus.cc:3037] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.751881 15261 catalog_manager.cc:5495] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:19.762645 15361 raft_consensus.cc:1261] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:19.777801 16610 tablet_replica.cc:330] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:19.779452 16610 raft_consensus.cc:2229] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:19.780174 16610 raft_consensus.cc:2258] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:19.781739 16095 raft_consensus.cc:504] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.770753 16544 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260929 11:36:19.783579 16095 leader_election.cc:288] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
W20260929 11:36:19.784461 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 84543.3us
I20260929 11:36:19.802057 15433 raft_consensus.cc:1261] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:19.802515 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 18064e092cec4a5fbc144b23fcd5abaf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:19.816308 15433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:19.816967 15433 raft_consensus.cc:3037] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.819731 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26f6df46badd473ab3b02a550aa18cc2" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:19.820547 15361 raft_consensus.cc:3032] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:19.821329 15361 raft_consensus.cc:729] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:19.822422 15361 consensus_queue.cc:260] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.824088 15361 raft_consensus.cc:3037] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.824097 15433 raft_consensus.cc:2454] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:19.839277 16062 leader_election.cc:302] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:19.840377 16562 raft_consensus.cc:2781] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:19.840898 16562 raft_consensus.cc:686] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:19.841777 16562 consensus_queue.cc:237] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.843034 16610 ts_tablet_manager.cc:1905] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:19.843483 16544 raft_consensus.cc:979] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:19.843938 16544 raft_consensus.cc:1067] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:19.850699 16522 raft_consensus.cc:979] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:19.851408 16522 raft_consensus.cc:1067] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:19.852510 16609 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:19.854749 16095 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48220
I20260929 11:36:19.855458 16095 raft_consensus.cc:482] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:19.855837 16095 raft_consensus.cc:3037] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.865664 15361 raft_consensus.cc:2454] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:19.866724 16095 raft_consensus.cc:504] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.867539 15433 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8351697a268a4337843da29ee5afac70"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49378
I20260929 11:36:19.868057 15433 raft_consensus.cc:482] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:19.868412 15433 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.875420 15360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:19.876219 15360 raft_consensus.cc:3032] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:19.876600 15360 raft_consensus.cc:729] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:19.877485 15360 consensus_queue.cc:260] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:19.885075 15360 raft_consensus.cc:3037] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.879478 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 18064e092cec4a5fbc144b23fcd5abaf with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:19.887010 16095 leader_election.cc:288] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:19.896374 15433 raft_consensus.cc:504] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:19.900219 15433 leader_election.cc:288] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:19.902313 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:19.904393 15361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:19.904776 15512 raft_consensus.cc:3032] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:19.906718 15512 raft_consensus.cc:729] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:19.910437 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eb6a5845e93469fb6516bd75d62c983" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:19.911096 15510 raft_consensus.cc:3037] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.932788 15361 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.939402 15512 consensus_queue.cc:260] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:19.942605 15512 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:19.920617 15259 catalog_manager.cc:5495] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:19.949144 15360 raft_consensus.cc:2454] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:19.983383 15512 raft_consensus.cc:2454] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:19.986971 15510 raft_consensus.cc:2454] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:19.988894 15361 raft_consensus.cc:2454] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:20.012813 16062 leader_election.cc:302] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf4734bb02e4108b00fabc552483a18, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:20.015683 16559 raft_consensus.cc:2781] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:20.064299 16522 raft_consensus.cc:979] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:20.064947 16522 raft_consensus.cc:1067] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
W20260929 11:36:20.065217 15330 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39689, user_credentials={real_user=slave}} blocked reactor thread for 169996us
I20260929 11:36:20.016309 16559 raft_consensus.cc:686] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:20.090713 15404 leader_election.cc:302] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
W20260929 11:36:20.245030 16062 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 232291us
I20260929 11:36:20.229863 16559 consensus_queue.cc:237] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:20.273743 16596 raft_consensus.cc:2781] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
W20260929 11:36:20.302196 15404 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 312373us
I20260929 11:36:20.316854 15356 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:20.318621 16631 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:20.294449 16596 raft_consensus.cc:686] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:20.335522 16596 consensus_queue.cc:237] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:20.332228 16544 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
W20260929 11:36:20.333524 15402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 269714us
W20260929 11:36:20.369602 16618 log.cc:924] Time spent T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: Append to log took a long time: real 0.131s user 0.003s sys 0.000s
I20260929 11:36:20.375182 15359 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:20.414031 16512 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:20.421854 16610 ts_tablet_manager.cc:1918] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260929 11:36:20.422447 16610 log.cc:1196] T 2454e1272e994181a08e49e54473af7a P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/2454e1272e994181a08e49e54473af7a
I20260929 11:36:20.435686 15439 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:20.436630 15439 raft_consensus.cc:482] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:20.436991 15439 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:20.458662 15439 raft_consensus.cc:504] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:20.478086 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:20.479056 15362 raft_consensus.cc:3032] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:20.479503 15362 raft_consensus.cc:729] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:20.492007 15439 leader_election.cc:288] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:20.499486 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260929 11:36:20.526448 15405 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39689, user_credentials={real_user=slave}} blocked reactor thread for 209754us
I20260929 11:36:20.530627 15355 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260929 11:36:20.536960 15476 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 238672us
W20260929 11:36:20.609083 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 198847us
I20260929 11:36:20.536298 16610 tablet_replica.cc:330] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:20.515950 15362 consensus_queue.cc:260] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:20.542362 16623 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260929 11:36:20.643412 16097 raft_consensus.cc:1261] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:20.640801 16096 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:20.661761 15431 raft_consensus.cc:1261] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:20.663395 15435 raft_consensus.cc:1261] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:20.665997 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 2454e1272e994181a08e49e54473af7a (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:20.707756 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:20.708806 15512 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:20.711483 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 44140.1us
W20260929 11:36:20.717947 15405 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39689, user_credentials={real_user=slave}} blocked reactor thread for 50535.2us
W20260929 11:36:20.669394 16062 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 110386us
I20260929 11:36:20.724793 15512 raft_consensus.cc:2454] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:20.736024 16624 consensus_queue.cc:1035] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260929 11:36:20.744086 15404 leader_election.cc:302] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:20.778235 16640 raft_consensus.cc:2781] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:20.784130 16610 raft_consensus.cc:2229] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:20.785250 16610 raft_consensus.cc:2258] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:20.793015 15259 catalog_manager.cc:5495] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:20.805603 15438 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:20.808365 16640 raft_consensus.cc:686] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
W20260929 11:36:20.822839 15330 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39689, user_credentials={real_user=slave}} blocked reactor thread for 96814.7us
I20260929 11:36:20.823685 15362 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:20.820330 16562 consensus_queue.cc:1035] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260929 11:36:20.833138 16563 consensus_queue.cc:1035] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:20.809360 16640 consensus_queue.cc:237] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:20.871130 16610 ts_tablet_manager.cc:1905] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:21.004803 15513 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:21.011633 15513 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:21.031587 15359 raft_consensus.cc:1261] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:21.031985 15362 raft_consensus.cc:2454] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:21.038488 16630 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:21.062716 15261 catalog_manager.cc:5495] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260929 11:36:21.104749 16060 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 69841.9us
I20260929 11:36:21.129297 16563 consensus_queue.cc:1035] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260929 11:36:21.154609 16637 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
W20260929 11:36:21.172183 16060 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 64052.3us
I20260929 11:36:21.195277 15356 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:21.197825 16641 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:21.214613 16547 raft_consensus.cc:482] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
I20260929 11:36:21.228531 16547 raft_consensus.cc:504] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:21.238920 16547 leader_election.cc:288] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:21.277848 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
W20260929 11:36:21.357121 16667 log.cc:924] Time spent T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260929 11:36:21.361405 16460 raft_consensus.cc:482] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
W20260929 11:36:21.359850 16062 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 231197us
I20260929 11:36:21.371613 16460 raft_consensus.cc:504] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:21.377396 16460 leader_election.cc:288] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:21.381955 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:36:21.382171 16610 ts_tablet_manager.cc:1918] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:21.382789 16610 log.cc:1196] T 18064e092cec4a5fbc144b23fcd5abaf P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/18064e092cec4a5fbc144b23fcd5abaf
I20260929 11:36:21.390996 16610 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47180 (request call id 808) took 1522 ms. Trace:
I20260929 11:36:21.393746 15262 catalog_manager.cc:5495] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from adf4734bb02e4108b00fabc552483a18 (127.13.221.195) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:21.391553 16610 rpcz_store.cc:276] 0929 11:36:19.868686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:19.870832 (+ 2146us) service_pool.cc:227] Handling call
0929 11:36:20.520492 (+649660us) ts_tablet_manager.cc:1145] Deleting tablet 18064e092cec4a5fbc144b23fcd5abaf
0929 11:36:20.523286 (+ 2794us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0929 11:36:21.061359 (+538073us) tablet_metadata.cc:641] Metadata flushed
0929 11:36:21.381839 (+320480us) tablet_metadata.cc:641] Metadata flushed
0929 11:36:21.390886 (+ 9047us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":99776,"tablet-delete.queue_time_us":612494}
I20260929 11:36:21.427487 16627 raft_consensus.cc:482] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
I20260929 11:36:21.427989 16627 raft_consensus.cc:504] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:36:21.471834 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 101304us
I20260929 11:36:21.473807 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 18064e092cec4a5fbc144b23fcd5abaf (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:21.494206 15364 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:21.494900 15364 raft_consensus.cc:595] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:21.495242 15364 raft_consensus.cc:603] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260929 11:36:21.481478 16619 raft_consensus.cc:482] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
I20260929 11:36:21.505108 16627 leader_election.cc:288] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:21.505867 15364 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:21.506417 15364 raft_consensus.cc:595] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:21.507905 16619 raft_consensus.cc:504] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:21.510413 16619 leader_election.cc:288] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:21.511173 15362 raft_consensus.cc:1261] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:21.512449 15431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:36:21.513159 16619 raft_consensus.cc:979] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:21.513072 15431 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 1.
I20260929 11:36:21.513603 16619 raft_consensus.cc:1067] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:21.514441 15329 leader_election.cc:302] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:36:21.517587 16616 raft_consensus.cc:2781] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:21.517983 16616 raft_consensus.cc:482] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adf4734bb02e4108b00fabc552483a18)
I20260929 11:36:21.518365 16616 raft_consensus.cc:3037] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.525731 15359 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:21.528308 16640 consensus_queue.cc:1035] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:21.530165 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:36:21.565284 15507 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:55996
I20260929 11:36:21.565976 15507 raft_consensus.cc:595] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
W20260929 11:36:21.573776 15404 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 86891.3us
I20260929 11:36:21.599255 15430 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ae0c7572ce72494f9c505c54480619fa"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:21.599977 15430 raft_consensus.cc:595] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:21.607925 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:36:21.610508 16616 raft_consensus.cc:504] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:21.612534 15364 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:21.613037 16616 leader_election.cc:288] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:21.613320 15364 raft_consensus.cc:595] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:21.614653 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260929 11:36:21.616446 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:21.617069 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:21.629609 15404 leader_election.cc:302] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:36:21.630625 16675 raft_consensus.cc:2726] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:36:21.633646 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:37107, user_credentials={real_user=slave}} blocked reactor thread for 87848.2us
I20260929 11:36:21.637713 15507 consensus_queue.cc:237] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:21.647012 15430 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:21.647722 15430 raft_consensus.cc:482] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:21.648110 15430 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.648525 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:21.651971 15510 raft_consensus.cc:1261] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:21.683054 15510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "087e3c24b1194324b1cbedc8cbbdf3cd" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:36:21.682152 15512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8119561598f743b799cb3b1843a3507f" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:36:21.687701 15261 catalog_manager.cc:5495] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } }
I20260929 11:36:21.701987 16622 consensus_queue.cc:1035] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260929 11:36:21.708289 15329 leader_election.cc:302] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:36:21.716025 15329 leader_election.cc:302] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:36:21.718439 16608 raft_consensus.cc:2726] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:21.720928 15504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:21.722249 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adf4734bb02e4108b00fabc552483a18" is_pre_election: true
I20260929 11:36:21.723356 16651 raft_consensus.cc:2726] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:21.727789 15430 raft_consensus.cc:504] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:21.739828 15329 leader_election.cc:302] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79f6b689389549ce8079ff46fd514467; no voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18
I20260929 11:36:21.747751 15430 leader_election.cc:288] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:21.745182 16651 raft_consensus.cc:2726] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:21.752281 15362 raft_consensus.cc:1261] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:21.753185 16096 raft_consensus.cc:1261] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:21.756213 16612 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260929 11:36:21.760248 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:21.760277 16544 consensus_queue.cc:1035] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:21.760998 15362 raft_consensus.cc:3032] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:21.761351 15362 raft_consensus.cc:729] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:21.762118 15362 consensus_queue.cc:260] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:21.763427 15362 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.756405 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:21.768623 15508 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.782644 16640 raft_consensus.cc:979] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:21.785609 16640 raft_consensus.cc:1067] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:21.789110 16096 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:21.784595 16612 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:21.809574 16093 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ae0c7572ce72494f9c505c54480619fa"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48212
I20260929 11:36:21.810225 16093 raft_consensus.cc:482] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:21.810576 16093 raft_consensus.cc:3037] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.816119 15259 catalog_manager.cc:5495] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:21.825488 15508 raft_consensus.cc:2454] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:21.832104 15404 leader_election.cc:302] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:21.832509 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet 290cd2101f81472384670fdea31eaaf6 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:21.833042 16640 raft_consensus.cc:2781] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:21.836753 16640 raft_consensus.cc:686] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:21.854151 15356 raft_consensus.cc:1226] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Rejecting Update request from peer adf4734bb02e4108b00fabc552483a18 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:21.861994 16544 consensus_queue.cc:1046] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:21.863857 16544 raft_consensus.cc:3032] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:21.864189 16544 raft_consensus.cc:729] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:21.865103 16544 consensus_queue.cc:260] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:21.865521 16640 consensus_queue.cc:237] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:21.866457 16544 raft_consensus.cc:3037] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.887305 15362 raft_consensus.cc:2454] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:21.891139 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 290cd2101f81472384670fdea31eaaf6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:21.894927 16547 raft_consensus.cc:979] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:21.895401 16547 raft_consensus.cc:1067] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:21.910847 16097 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48220
I20260929 11:36:21.911406 16097 raft_consensus.cc:482] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:21.911720 16097 raft_consensus.cc:3037] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.918565 16097 raft_consensus.cc:504] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:21.924513 15356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:21.925117 15356 raft_consensus.cc:3032] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:21.925408 15356 raft_consensus.cc:729] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:21.926266 16681 tablet_replica.cc:330] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:21.894555 15362 raft_consensus.cc:2932] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:21.926074 15356 consensus_queue.cc:260] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:21.927616 15356 raft_consensus.cc:3037] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.933985 15505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9309f2844e444faaf2fbd9f0b77b132" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:21.934691 15505 raft_consensus.cc:3037] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.937855 15356 raft_consensus.cc:2454] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:21.933820 16093 raft_consensus.cc:504] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:21.954284 16670 raft_consensus.cc:979] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:21.965283 16670 raft_consensus.cc:1067] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:21.966871 16093 leader_election.cc:288] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:21.967142 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0c7572ce72494f9c505c54480619fa" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:21.967810 15364 raft_consensus.cc:3037] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.972898 15359 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41838
I20260929 11:36:21.973196 15430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0c7572ce72494f9c505c54480619fa" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:21.973595 15359 raft_consensus.cc:482] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:21.973953 15430 raft_consensus.cc:3032] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:21.974015 15359 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.974365 15430 raft_consensus.cc:729] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:21.975454 15430 consensus_queue.cc:260] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:21.977186 15430 raft_consensus.cc:3037] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:21.977432 16060 leader_election.cc:302] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:21.978834 16563 raft_consensus.cc:2781] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:21.934214 16097 leader_election.cc:288] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:21.979343 16563 raft_consensus.cc:686] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:21.959293 15505 raft_consensus.cc:2454] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:21.980243 16563 consensus_queue.cc:237] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:21.985028 15259 catalog_manager.cc:5495] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:21.985085 15364 raft_consensus.cc:2454] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:21.995599 16060 leader_election.cc:302] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:21.996592 16623 raft_consensus.cc:2781] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:21.997123 16623 raft_consensus.cc:686] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:21.998039 16623 consensus_queue.cc:237] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:21.999539 16681 raft_consensus.cc:2229] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:22.000607 16681 raft_consensus.cc:2258] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:22.003486 15430 raft_consensus.cc:2454] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:22.006654 15359 raft_consensus.cc:504] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:22.008751 15359 leader_election.cc:288] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:22.018775 15505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:22.019423 15505 raft_consensus.cc:3032] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:22.019719 15505 raft_consensus.cc:729] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:22.021260 15505 consensus_queue.cc:260] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:22.035579 15505 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:22.024948 16681 ts_tablet_manager.cc:1905] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:22.051541 15259 catalog_manager.cc:5495] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:22.083837 15430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:22.084786 15430 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:22.104429 15430 raft_consensus.cc:2454] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:22.105372 15329 leader_election.cc:302] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:36:22.106199 16620 raft_consensus.cc:2781] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:22.106817 16620 raft_consensus.cc:686] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:22.108093 15505 raft_consensus.cc:2454] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:22.107935 16620 consensus_queue.cc:237] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:22.121160 15259 catalog_manager.cc:5495] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 1 to 2, leader changed from adf4734bb02e4108b00fabc552483a18 (127.13.221.195) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:22.121774 15258 catalog_manager.cc:5495] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:22.127350 16681 ts_tablet_manager.cc:1918] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:22.127801 16681 log.cc:1196] T 290cd2101f81472384670fdea31eaaf6 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/290cd2101f81472384670fdea31eaaf6
I20260929 11:36:22.129376 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet 290cd2101f81472384670fdea31eaaf6 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:22.294894 15505 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:22.296168 16640 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:22.306602 15364 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:22.308187 16640 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:22.411908 15364 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:22.413139 16623 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:22.423635 15430 raft_consensus.cc:1261] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:22.424947 16623 consensus_queue.cc:1035] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:22.496451 15364 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:22.497632 16563 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:22.505749 15508 raft_consensus.cc:1261] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:22.509189 16625 consensus_queue.cc:1035] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:22.531998 15508 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:22.533175 16647 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:22.551636 15437 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:22.561223 16547 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:22.776214 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:22.808017 15437 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2454e1272e994181a08e49e54473af7a"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:22.808544 15437 raft_consensus.cc:595] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
I20260929 11:36:22.810755 15364 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:22.811163 15364 raft_consensus.cc:595] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:22.813155 15437 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:22.813577 15437 raft_consensus.cc:595] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS adf4734bb02e4108b00fabc552483a18
I20260929 11:36:22.814548 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260929 11:36:22.816028 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:22.816651 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:22.854490 16640 raft_consensus.cc:979] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:22.855008 16640 raft_consensus.cc:1067] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:22.856458 15364 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2454e1272e994181a08e49e54473af7a"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41834
I20260929 11:36:22.856951 15364 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:22.857394 15364 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:22.862629 15364 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:22.864490 15364 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 3 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:22.865193 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:22.865535 16097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:22.865908 15437 raft_consensus.cc:3032] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:22.866037 16097 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:22.866291 15437 raft_consensus.cc:729] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:22.867231 15437 consensus_queue.cc:260] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:22.868515 15437 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:22.872762 16097 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 3.
I20260929 11:36:22.873790 15330 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:22.874447 16647 raft_consensus.cc:2781] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:22.874936 16647 raft_consensus.cc:686] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:22.875720 16647 consensus_queue.cc:237] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:22.876498 15437 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 3.
I20260929 11:36:22.885938 15259 catalog_manager.cc:5495] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 2 to 3, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260929 11:36:22.958055 15310 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: leader transfer in progress
W20260929 11:36:22.961987 15310 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 282bceebd7ed425db943d6b72f2513a1, TS 2b2ed85c4da64515a0664b6c0421e078 -> TS bf69c081fbc04bb398d116939cc78f21 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:36:22.962275 15310 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 282bceebd7ed425db943d6b72f2513a1, TS 2b2ed85c4da64515a0664b6c0421e078 -> TS bf69c081fbc04bb398d116939cc78f21 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:36:22.965400 15310 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet b96455e9e76c407ab71b312b680a9c93, TS 79f6b689389549ce8079ff46fd514467 -> TS bf69c081fbc04bb398d116939cc78f21 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:36:22.965665 15310 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet b96455e9e76c407ab71b312b680a9c93, TS 79f6b689389549ce8079ff46fd514467 -> TS bf69c081fbc04bb398d116939cc78f21 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:36:22.968634 15310 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 29ac378824b145ee99c987e4c3413ee9, TS 79f6b689389549ce8079ff46fd514467 -> TS bf69c081fbc04bb398d116939cc78f21 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:36:22.968843 15310 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 29ac378824b145ee99c987e4c3413ee9, TS 79f6b689389549ce8079ff46fd514467 -> TS bf69c081fbc04bb398d116939cc78f21 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:36:22.971772 15310 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 5471502e24764effae2ab947ad5c8cb5, TS adf4734bb02e4108b00fabc552483a18 -> TS bf69c081fbc04bb398d116939cc78f21 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
W20260929 11:36:22.972002 15310 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 5471502e24764effae2ab947ad5c8cb5, TS adf4734bb02e4108b00fabc552483a18 -> TS bf69c081fbc04bb398d116939cc78f21 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:23.041404 16626 raft_consensus.cc:979] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:23.041949 16627 raft_consensus.cc:1067] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:23.043267 15505 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:47196
I20260929 11:36:23.043826 15505 raft_consensus.cc:482] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:23.044190 15505 raft_consensus.cc:3037] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:23.049983 15505 raft_consensus.cc:504] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:23.051829 15505 leader_election.cc:288] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:23.052659 15431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:23.052878 16093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7721312177b84c71ae4f6bea151091a8" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:23.053237 15431 raft_consensus.cc:3032] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:23.053448 16093 raft_consensus.cc:3037] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:23.053591 15431 raft_consensus.cc:729] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:23.054363 15431 consensus_queue.cc:260] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:23.055548 15431 raft_consensus.cc:3037] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:23.059818 16093 raft_consensus.cc:2454] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:23.061704 15479 leader_election.cc:302] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf4734bb02e4108b00fabc552483a18, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:23.062507 16544 raft_consensus.cc:2781] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:23.063552 16544 raft_consensus.cc:686] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:23.064899 16544 consensus_queue.cc:237] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:23.076272 15431 raft_consensus.cc:2454] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:23.078230 15259 catalog_manager.cc:5495] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 2 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:23.113919 16544 raft_consensus.cc:482] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:23.114416 16544 raft_consensus.cc:504] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:23.116866 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467" is_pre_election: true
I20260929 11:36:23.117179 15431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078" is_pre_election: true
I20260929 11:36:23.117682 16544 leader_election.cc:288] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:23.117820 15431 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 1.
I20260929 11:36:23.117556 15364 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:23.119282 15478 leader_election.cc:302] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:23.120213 16703 raft_consensus.cc:2781] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:23.120615 16703 raft_consensus.cc:482] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:23.120936 16703 raft_consensus.cc:3037] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:23.128922 16703 raft_consensus.cc:504] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:23.130465 16703 leader_election.cc:288] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 3 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:23.131197 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:23.131377 15431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fd843b2d55b4a9bb4755e0841e3c66e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:23.131805 15359 raft_consensus.cc:3037] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:23.131990 15431 raft_consensus.cc:3037] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:36:23.137246 15359 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 3.
I20260929 11:36:23.138286 15476 leader_election.cc:302] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:23.138510 15431 raft_consensus.cc:2454] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 3.
I20260929 11:36:23.139142 16703 raft_consensus.cc:2781] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:23.139650 16703 raft_consensus.cc:686] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 3 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:23.140508 16703 consensus_queue.cc:237] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:23.154301 15259 catalog_manager.cc:5495] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:23.174199 16706 raft_consensus.cc:979] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:23.174696 16620 raft_consensus.cc:1067] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:23.176307 15431 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:23.176944 15431 raft_consensus.cc:482] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:23.177353 15431 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:23.184521 15431 raft_consensus.cc:504] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:23.186578 15431 leader_election.cc:288] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 3 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:23.187505 15508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:23.187593 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282bceebd7ed425db943d6b72f2513a1" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:23.188282 15508 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:23.188656 15359 raft_consensus.cc:3032] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:23.189015 15359 raft_consensus.cc:729] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:23.189725 15359 consensus_queue.cc:260] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:23.190855 15359 raft_consensus.cc:3037] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:23.195492 15508 raft_consensus.cc:2454] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 3.
I20260929 11:36:23.196743 15404 leader_election.cc:302] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:23.197630 16626 raft_consensus.cc:2781] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:23.198093 16626 raft_consensus.cc:686] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:23.199502 16626 consensus_queue.cc:237] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:23.209618 15259 catalog_manager.cc:5495] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 2 to 3, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 3 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:23.210219 15359 raft_consensus.cc:2454] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 3.
I20260929 11:36:23.289414 16097 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260929 11:36:23.290477 16620 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:23.299973 15437 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260929 11:36:23.303438 16620 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:23.456205 15437 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:23.457479 16703 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:23.459932 16097 raft_consensus.cc:1261] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:23.461398 16703 consensus_queue.cc:1035] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:23.563711 15437 raft_consensus.cc:1261] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:23.565239 16544 consensus_queue.cc:1035] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:23.576227 15359 raft_consensus.cc:1261] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:23.578574 16544 consensus_queue.cc:1035] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:23.664301 15359 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:36:23.665526 16626 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:23.681704 15505 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:36:23.684748 16721 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:23.856743 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:23.899673 15437 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:23.900245 15437 raft_consensus.cc:595] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
I20260929 11:36:23.902544 15508 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:55996
I20260929 11:36:23.903143 15508 raft_consensus.cc:595] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
I20260929 11:36:23.905514 15359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bbd4efefe8d54575b3b5575a504bb0a1"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:23.906049 15359 raft_consensus.cc:595] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:23.907094 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260929 11:36:23.908598 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:23.909215 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:24.040180 15359 consensus_queue.cc:237] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
W20260929 11:36:24.049111 15330 consensus_peers.cc:487] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6926107852c74f4aaf37989b571c292a. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:24.050297 15437 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:24.052768 16720 raft_consensus.cc:979] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:24.053194 16720 raft_consensus.cc:1067] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:24.053476 15505 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:24.054662 15364 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41834
I20260929 11:36:24.055200 15364 raft_consensus.cc:482] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:24.055512 15364 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:24.061862 15364 raft_consensus.cc:504] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:24.064020 15364 leader_election.cc:288] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 3 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:24.067226 16709 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:24.068231 16706 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:24.070118 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:24.070318 15505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:24.071352 15505 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:24.071480 15437 raft_consensus.cc:3032] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:24.071875 15437 raft_consensus.cc:729] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:24.080436 15437 consensus_queue.cc:260] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:24.080703 15505 raft_consensus.cc:2454] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 3.
I20260929 11:36:24.081648 15437 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:24.088773 15329 leader_election.cc:302] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:24.089790 16706 raft_consensus.cc:2781] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:24.090629 16620 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.091954 15437 raft_consensus.cc:2454] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 3.
I20260929 11:36:24.095728 16706 raft_consensus.cc:686] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:24.094110 15508 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.096674 16706 consensus_queue.cc:237] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:24.099850 15437 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.106304 15431 consensus_queue.cc:237] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:24.119359 15258 catalog_manager.cc:5495] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:24.124601 15405 consensus_peers.cc:487] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8351697a268a4337843da29ee5afac70. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:24.127041 15259 catalog_manager.cc:5495] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 2 to 3, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:24.128286 15364 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:24.130369 16720 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:24.133473 16544 raft_consensus.cc:979] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:24.133900 16544 raft_consensus.cc:1067] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:24.137292 15359 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41838
I20260929 11:36:24.137439 15508 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:24.137851 15359 raft_consensus.cc:482] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:24.138206 15359 raft_consensus.cc:3037] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:24.138733 16720 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:24.145087 15359 raft_consensus.cc:504] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:24.149380 15505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:24.150192 15505 raft_consensus.cc:3032] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:24.150641 15505 raft_consensus.cc:729] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:24.151491 15505 consensus_queue.cc:260] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:24.158602 15505 raft_consensus.cc:3037] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:24.148633 16093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f9ef265661b4a1b872b075ece5bb40d" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:24.160858 16093 raft_consensus.cc:3037] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:24.172032 15359 leader_election.cc:288] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Requested vote from peers adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:24.178400 15508 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.194388 16093 raft_consensus.cc:2454] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:24.195789 15330 leader_election.cc:302] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:24.180594 15364 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.206800 16706 raft_consensus.cc:2781] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:24.209396 16706 raft_consensus.cc:686] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:24.210265 16706 consensus_queue.cc:237] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:24.171808 16721 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.217861 15259 catalog_manager.cc:5495] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.229051 15505 raft_consensus.cc:2454] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:24.239629 15259 catalog_manager.cc:5495] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 1 to 2, leader changed from adf4734bb02e4108b00fabc552483a18 (127.13.221.195) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:24.241595 15431 consensus_queue.cc:237] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:24.253012 15508 raft_consensus.cc:1261] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:24.253252 15405 consensus_peers.cc:487] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29ac378824b145ee99c987e4c3413ee9. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:24.254256 16720 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:24.255515 15364 raft_consensus.cc:1261] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:24.259366 16735 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:24.263723 16627 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.265410 15505 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.277942 15359 consensus_queue.cc:237] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:24.275166 15364 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.282364 15259 catalog_manager.cc:5495] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:24.299960 15330 consensus_peers.cc:487] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20bfb5db2aab4679856838ec11feffc9. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:24.300669 15437 raft_consensus.cc:1261] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:24.300909 15505 raft_consensus.cc:1261] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:24.302665 16620 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:24.303544 16706 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:24.330009 16620 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.393803 15259 catalog_manager.cc:5495] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:24.377483 15437 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.461676 15505 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:24.463502 16706 raft_consensus.cc:979] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:24.465189 16706 raft_consensus.cc:1067] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
W20260929 11:36:24.487917 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 86826.5us
I20260929 11:36:24.492447 15434 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bbd4efefe8d54575b3b5575a504bb0a1"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:24.493310 15434 raft_consensus.cc:482] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:24.493817 15434 raft_consensus.cc:3037] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:24.531524 15431 raft_consensus.cc:1261] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:36:24.541427 16706 consensus_queue.cc:1035] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:24.588078 15434 raft_consensus.cc:504] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:24.614249 15434 leader_election.cc:288] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:24.615738 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd4efefe8d54575b3b5575a504bb0a1" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:24.616619 15509 raft_consensus.cc:3037] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:24.616747 16060 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 55846.4us
I20260929 11:36:24.622334 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd4efefe8d54575b3b5575a504bb0a1" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:24.623036 15362 raft_consensus.cc:3032] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:24.623409 15362 raft_consensus.cc:729] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:24.624362 15362 consensus_queue.cc:260] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:24.628387 15362 raft_consensus.cc:3037] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:24.630362 15509 raft_consensus.cc:2454] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:24.631608 15404 leader_election.cc:302] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:24.633476 16720 raft_consensus.cc:2781] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:24.634361 16720 raft_consensus.cc:686] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:24.635411 16720 consensus_queue.cc:237] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:24.640911 15362 raft_consensus.cc:2454] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:24.667058 16752 ts_tablet_manager.cc:927] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:24.708026 15505 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:24.711714 16746 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:24.713822 16096 raft_consensus.cc:1261] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:24.718497 16756 ts_tablet_manager.cc:927] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:24.719277 15261 catalog_manager.cc:5495] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:24.721441 16620 consensus_queue.cc:1035] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:24.730660 16752 tablet_copy_client.cc:316] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:24.735967 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 6926107852c74f4aaf37989b571c292a from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:24.736634 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 6926107852c74f4aaf37989b571c292a from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-6926107852c74f4aaf37989b571c292a
I20260929 11:36:24.737711 15505 raft_consensus.cc:1261] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:36:24.759881 16746 consensus_queue.cc:1035] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:24.771284 15374 tablet_copy_source_session.cc:205] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:24.802163 16762 ts_tablet_manager.cc:927] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:24.802337 16756 tablet_copy_client.cc:316] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:24.819329 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 8351697a268a4337843da29ee5afac70 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:24.819942 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 8351697a268a4337843da29ee5afac70 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-8351697a268a4337843da29ee5afac70
I20260929 11:36:24.825071 16752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6926107852c74f4aaf37989b571c292a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:24.833657 15449 tablet_copy_source_session.cc:205] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:24.843569 16756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8351697a268a4337843da29ee5afac70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:24.855098 16752 tablet_copy_client.cc:791] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:24.855751 16752 tablet_copy_client.cc:655] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:24.861059 16752 tablet_copy_client.cc:531] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:24.861021 16765 ts_tablet_manager.cc:927] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:24.869524 16762 tablet_copy_client.cc:316] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:24.870781 16765 tablet_copy_client.cc:316] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:24.872048 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 20bfb5db2aab4679856838ec11feffc9 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:24.872712 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 20bfb5db2aab4679856838ec11feffc9 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-20bfb5db2aab4679856838ec11feffc9
I20260929 11:36:24.873924 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 29ac378824b145ee99c987e4c3413ee9 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:24.874460 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 29ac378824b145ee99c987e4c3413ee9 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-29ac378824b145ee99c987e4c3413ee9
I20260929 11:36:24.881114 15374 tablet_copy_source_session.cc:205] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:24.884986 16762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20bfb5db2aab4679856838ec11feffc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:24.887818 15449 tablet_copy_source_session.cc:205] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:24.888818 16752 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:24.896430 16765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ac378824b145ee99c987e4c3413ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:24.905983 16762 tablet_copy_client.cc:791] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:24.906586 16762 tablet_copy_client.cc:655] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:24.916584 16756 tablet_copy_client.cc:791] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:24.928746 16756 tablet_copy_client.cc:655] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:24.931949 16762 tablet_copy_client.cc:531] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:24.934265 16756 tablet_copy_client.cc:531] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:24.941483 16762 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:24.953776 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:24.966279 16752 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:24.967300 16752 tablet_bootstrap.cc:492] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:24.968008 16752 ts_tablet_manager.cc:1397] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.079s user 0.009s sys 0.049s
I20260929 11:36:24.971093 16752 raft_consensus.cc:348] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:24.971983 16752 raft_consensus.cc:729] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:24.972631 16752 consensus_queue.cc:260] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:24.973271 16765 tablet_copy_client.cc:791] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:24.974133 16765 tablet_copy_client.cc:655] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:24.980087 16752 ts_tablet_manager.cc:1428] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.012s user 0.006s sys 0.003s
I20260929 11:36:24.976715 16756 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:24.981855 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-6926107852c74f4aaf37989b571c292a received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:24.982267 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-6926107852c74f4aaf37989b571c292a on tablet 6926107852c74f4aaf37989b571c292a with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:24.984058 16765 tablet_copy_client.cc:531] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:25.006273 16762 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:25.007236 16762 tablet_bootstrap.cc:492] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:25.007901 16762 ts_tablet_manager.cc:1397] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.067s user 0.015s sys 0.012s
I20260929 11:36:25.010983 16765 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:25.018805 16762 raft_consensus.cc:348] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:25.020231 16762 raft_consensus.cc:729] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:25.026087 16762 consensus_queue.cc:260] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:25.029699 16097 raft_consensus.cc:1203] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:25.030396 16762 ts_tablet_manager.cc:1428] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.022s user 0.010s sys 0.000s
I20260929 11:36:25.035993 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-20bfb5db2aab4679856838ec11feffc9 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:25.036537 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-20bfb5db2aab4679856838ec11feffc9 on tablet 20bfb5db2aab4679856838ec11feffc9 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:25.095618 16765 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:25.096560 16765 tablet_bootstrap.cc:492] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:25.097478 16765 ts_tablet_manager.cc:1397] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.087s user 0.030s sys 0.027s
I20260929 11:36:25.098423 16756 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:25.099439 16756 tablet_bootstrap.cc:492] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:25.100193 16756 ts_tablet_manager.cc:1397] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.124s user 0.029s sys 0.045s
I20260929 11:36:25.100426 16765 raft_consensus.cc:348] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:25.102277 16765 raft_consensus.cc:729] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:25.103070 16765 consensus_queue.cc:260] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:25.104667 16756 raft_consensus.cc:348] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:25.105625 16756 raft_consensus.cc:729] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:25.106056 16765 ts_tablet_manager.cc:1428] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20260929 11:36:25.110466 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-29ac378824b145ee99c987e4c3413ee9 received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:25.110874 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-29ac378824b145ee99c987e4c3413ee9 on tablet 29ac378824b145ee99c987e4c3413ee9 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:25.106356 16756 consensus_queue.cc:260] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:25.114219 16756 ts_tablet_manager.cc:1428] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260929 11:36:25.119706 15449 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-8351697a268a4337843da29ee5afac70 received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:25.120157 15449 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-8351697a268a4337843da29ee5afac70 on tablet 8351697a268a4337843da29ee5afac70 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:25.129704 15362 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:25.130354 15362 raft_consensus.cc:595] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:25.133373 15438 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f969b15260af489b992eeca4080e55ed"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:25.133841 15438 raft_consensus.cc:595] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS adf4734bb02e4108b00fabc552483a18
I20260929 11:36:25.135094 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260929 11:36:25.136698 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:25.137383 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:25.191334 15364 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:25.192739 16736 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:25.308763 16097 raft_consensus.cc:1203] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:25.412412 16097 raft_consensus.cc:1203] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:25.414839 15505 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260929 11:36:25.420480 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 72677.2us
I20260929 11:36:25.438217 16626 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:25.447140 16775 raft_consensus.cc:979] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:25.447818 16626 raft_consensus.cc:1067] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:25.453686 15504 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f969b15260af489b992eeca4080e55ed"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:47196
I20260929 11:36:25.454320 15504 raft_consensus.cc:482] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:25.454706 15504 raft_consensus.cc:3037] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:25.466662 15504 raft_consensus.cc:504] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:25.470675 15504 leader_election.cc:288] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:25.471936 15430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f969b15260af489b992eeca4080e55ed" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:25.472867 15430 raft_consensus.cc:3032] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:25.474267 15430 raft_consensus.cc:729] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:25.475147 15430 consensus_queue.cc:260] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:25.487943 16097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f969b15260af489b992eeca4080e55ed" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:25.489034 16097 raft_consensus.cc:3037] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:25.477164 15430 raft_consensus.cc:3037] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:25.541486 15430 raft_consensus.cc:2454] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:25.543006 16778 raft_consensus.cc:979] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:25.543386 15478 leader_election.cc:302] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:25.543509 16778 raft_consensus.cc:1067] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:25.543555 16097 raft_consensus.cc:2454] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:25.544720 16776 raft_consensus.cc:2781] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:25.545190 16776 raft_consensus.cc:686] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:25.546083 16776 consensus_queue.cc:237] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:25.551098 15437 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:25.551680 15437 raft_consensus.cc:482] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:25.552016 15437 raft_consensus.cc:3037] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:25.569538 15437 raft_consensus.cc:504] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:25.569118 16097 raft_consensus.cc:1203] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260929 11:36:25.575320 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:25.575814 15359 raft_consensus.cc:3032] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:25.576113 15359 raft_consensus.cc:729] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:25.576831 15359 consensus_queue.cc:260] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:25.577735 15359 raft_consensus.cc:3037] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:25.580559 15437 leader_election.cc:288] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:25.581596 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdd351cd28a49e5b8a1ed5513b22cf7" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:25.582216 15507 raft_consensus.cc:3037] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:25.582232 15261 catalog_manager.cc:5495] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 2 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:25.592073 15359 raft_consensus.cc:2454] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:25.599861 15402 leader_election.cc:302] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:36:25.600859 16721 raft_consensus.cc:2781] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:25.601377 16721 raft_consensus.cc:686] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:25.603140 16721 consensus_queue.cc:237] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:25.599771 15507 raft_consensus.cc:2454] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:25.617712 15259 catalog_manager.cc:5495] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:25.666812 16724 raft_consensus.cc:1050] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:25.668877 16724 consensus_queue.cc:237] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:25.675105 15507 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.675376 16096 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.675623 15430 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.677033 16724 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:25.678184 16778 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:25.681054 16777 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:25.700699 16724 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.702301 15437 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.719702 15259 catalog_manager.cc:5495] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.723672 16096 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.730216 15504 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.755753 15362 consensus_queue.cc:237] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:25.760579 15504 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:25.760653 16096 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:25.761934 16781 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:25.763293 16780 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:25.769945 16781 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.771433 16096 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.775498 15504 raft_consensus.cc:2932] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.781054 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6926107852c74f4aaf37989b571c292a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:25.787052 15259 catalog_manager.cc:5495] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:25.799602 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet 6926107852c74f4aaf37989b571c292a with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:25.801575 16800 tablet_replica.cc:330] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:25.802809 16800 raft_consensus.cc:2229] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:25.803654 16800 raft_consensus.cc:2258] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:25.807535 16800 ts_tablet_manager.cc:1905] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:25.823665 16800 ts_tablet_manager.cc:1918] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:25.824098 16800 log.cc:1196] T 6926107852c74f4aaf37989b571c292a P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/6926107852c74f4aaf37989b571c292a
I20260929 11:36:25.825614 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet 6926107852c74f4aaf37989b571c292a (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:25.883195 16781 raft_consensus.cc:1050] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:25.885743 16781 consensus_queue.cc:237] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:25.900071 16775 raft_consensus.cc:1050] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:25.901360 16097 raft_consensus.cc:1261] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.902803 16781 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:25.902756 16775 consensus_queue.cc:237] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:25.907532 15437 raft_consensus.cc:1261] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.909592 16781 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:25.925220 15504 raft_consensus.cc:1261] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.926666 16781 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:25.935911 16779 raft_consensus.cc:1050] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:25.938496 16779 consensus_queue.cc:237] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:25.940829 15505 raft_consensus.cc:1261] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.943794 16626 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:25.944157 15362 raft_consensus.cc:1261] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.945668 16096 raft_consensus.cc:1261] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:25.947365 16787 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:25.946628 16724 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.952935 16097 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.956732 16806 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:25.968137 15504 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.981631 15431 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.984525 15259 catalog_manager.cc:5495] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:25.990099 15430 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260929 11:36:26.079583 15478 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 90691.7us
I20260929 11:36:26.101500 15364 raft_consensus.cc:1261] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:26.132746 16096 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:26.136284 16626 consensus_queue.cc:1035] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:26.137391 16747 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:26.138698 16820 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:26.151463 16096 raft_consensus.cc:1261] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:26.143829 16787 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.170219 16776 consensus_queue.cc:1035] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:26.173934 16096 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.184346 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260929 11:36:26.213094 15402 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 107759us
I20260929 11:36:26.215423 15359 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:26.219358 15259 catalog_manager.cc:5495] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.240636 15504 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.253760 15505 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:26.261410 16787 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260929 11:36:26.261543 15476 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 143337us
I20260929 11:36:26.272979 15507 raft_consensus.cc:1261] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:26.269492 15359 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
W20260929 11:36:26.278338 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 147598us
I20260929 11:36:26.282845 15356 consensus_queue.cc:237] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.284612 16823 consensus_queue.cc:1035] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:26.341652 16818 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260929 11:36:26.365324 15329 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:33925, user_credentials={real_user=slave}} blocked reactor thread for 56306us
I20260929 11:36:26.375607 15430 raft_consensus.cc:1261] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:26.377942 16780 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:26.420437 16097 raft_consensus.cc:1261] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:26.438545 16819 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.441949 16781 consensus_queue.cc:1035] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:26.449252 15507 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.450126 16777 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.451743 15437 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.452474 16096 raft_consensus.cc:2932] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.473738 15364 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.478114 15437 consensus_queue.cc:237] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.491767 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 20bfb5db2aab4679856838ec11feffc9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:26.492822 15259 catalog_manager.cc:5495] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.497131 15262 catalog_manager.cc:5495] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.508564 16097 raft_consensus.cc:1261] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:26.509706 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 20bfb5db2aab4679856838ec11feffc9 with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:26.510078 15507 raft_consensus.cc:1261] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:26.510021 16823 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:26.513015 16779 consensus_queue.cc:1035] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:26.523376 16093 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.519919 16821 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.502369 16096 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.540290 15359 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18064e092cec4a5fbc144b23fcd5abaf"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:26.546013 16838 tablet_replica.cc:330] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:26.545760 15359 raft_consensus.cc:595] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:26.537868 15507 raft_consensus.cc:2932] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.557006 15509 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:55996
I20260929 11:36:26.558032 15509 raft_consensus.cc:595] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
I20260929 11:36:26.560021 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 29ac378824b145ee99c987e4c3413ee9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:26.562225 15430 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:26.562889 15430 raft_consensus.cc:595] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:26.569090 15437 consensus_queue.cc:237] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.570492 15438 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:26.571607 15438 raft_consensus.cc:595] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
I20260929 11:36:26.573935 16838 raft_consensus.cc:2229] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:26.574684 16838 raft_consensus.cc:2258] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:26.576648 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260929 11:36:26.578574 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:26.579208 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:26.580124 15509 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:26.581537 16787 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:26.583478 15262 catalog_manager.cc:5495] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.589264 16096 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:26.590787 16787 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:26.598639 16838 ts_tablet_manager.cc:1905] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:26.605403 16787 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.609292 16093 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.628466 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 29ac378824b145ee99c987e4c3413ee9 with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:26.631361 15262 catalog_manager.cc:5495] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.633018 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 8351697a268a4337843da29ee5afac70 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:26.637208 16839 tablet_replica.cc:330] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:26.638916 16839 raft_consensus.cc:2229] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:26.639870 16839 raft_consensus.cc:2258] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:26.648294 16839 ts_tablet_manager.cc:1905] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:26.651458 16838 ts_tablet_manager.cc:1918] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:26.652041 16838 log.cc:1196] T 20bfb5db2aab4679856838ec11feffc9 P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/20bfb5db2aab4679856838ec11feffc9
I20260929 11:36:26.642064 15509 raft_consensus.cc:2932] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:26.655153 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 20bfb5db2aab4679856838ec11feffc9 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:26.657580 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 8351697a268a4337843da29ee5afac70 with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:26.667032 16821 raft_consensus.cc:979] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:26.667582 16819 raft_consensus.cc:1067] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:26.669176 16096 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48212
I20260929 11:36:26.669682 16096 raft_consensus.cc:482] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:26.670006 16096 raft_consensus.cc:3037] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.677608 16096 raft_consensus.cc:504] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.679412 16096 leader_election.cc:288] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:26.680632 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:26.680943 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5af50e35934e4cd3960c886105fb34b7" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:26.681223 15509 raft_consensus.cc:3037] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.681499 15437 raft_consensus.cc:3032] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:26.681810 15437 raft_consensus.cc:729] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:26.686852 15437 consensus_queue.cc:260] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.688072 15509 raft_consensus.cc:2454] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:26.688174 15437 raft_consensus.cc:3037] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.689410 16062 leader_election.cc:302] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf4734bb02e4108b00fabc552483a18, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:26.690285 16783 raft_consensus.cc:2781] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:26.690742 16783 raft_consensus.cc:686] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:26.691541 16783 consensus_queue.cc:237] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.700922 16839 ts_tablet_manager.cc:1918] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:26.701483 16839 log.cc:1196] T 29ac378824b145ee99c987e4c3413ee9 P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/29ac378824b145ee99c987e4c3413ee9
I20260929 11:36:26.701666 15262 catalog_manager.cc:5495] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:26.703259 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 29ac378824b145ee99c987e4c3413ee9 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:26.706508 15437 raft_consensus.cc:2454] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:26.708042 16839 tablet_replica.cc:330] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:26.709265 16839 raft_consensus.cc:2229] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:26.709854 16839 raft_consensus.cc:2258] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:26.709913 16776 raft_consensus.cc:979] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:26.710573 16811 raft_consensus.cc:1067] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:26.712172 15356 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41838
I20260929 11:36:26.712662 15356 raft_consensus.cc:482] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:26.712950 15356 raft_consensus.cc:3037] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.713107 16839 ts_tablet_manager.cc:1905] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:26.717697 15356 raft_consensus.cc:504] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:26.719304 15356 leader_election.cc:288] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:26.720357 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:26.720965 15509 raft_consensus.cc:3032] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:26.721267 15509 raft_consensus.cc:729] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:26.722026 15509 consensus_queue.cc:260] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:26.723332 15509 raft_consensus.cc:3037] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.724620 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d4407712ee0451cb4fb2d8569e604cc" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:26.725121 15437 raft_consensus.cc:3037] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.726580 16839 ts_tablet_manager.cc:1918] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260929 11:36:26.727015 16839 log.cc:1196] T 8351697a268a4337843da29ee5afac70 P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/8351697a268a4337843da29ee5afac70
I20260929 11:36:26.728466 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 8351697a268a4337843da29ee5afac70 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:26.729532 15509 raft_consensus.cc:2454] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:26.730216 15437 raft_consensus.cc:2454] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:26.730489 15329 leader_election.cc:302] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:26.731284 16777 raft_consensus.cc:2781] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:26.731684 16777 raft_consensus.cc:686] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:26.732461 16777 consensus_queue.cc:237] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:26.741333 15262 catalog_manager.cc:5495] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 1 to 2, leader changed from adf4734bb02e4108b00fabc552483a18 (127.13.221.195) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:26.825263 16833 raft_consensus.cc:979] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:26.825819 16781 raft_consensus.cc:1067] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:26.827319 15430 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "18064e092cec4a5fbc144b23fcd5abaf"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:26.827960 15430 raft_consensus.cc:482] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:26.828363 15430 raft_consensus.cc:3037] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.829116 16821 raft_consensus.cc:979] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:26.829713 16787 raft_consensus.cc:1067] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:26.831292 15359 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41834
I20260929 11:36:26.831864 15359 raft_consensus.cc:482] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:26.832268 15359 raft_consensus.cc:3037] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.836177 15430 raft_consensus.cc:504] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.838706 15430 leader_election.cc:288] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:26.839766 16093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18064e092cec4a5fbc144b23fcd5abaf" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:26.840446 16093 raft_consensus.cc:3037] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.840591 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18064e092cec4a5fbc144b23fcd5abaf" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:26.841221 15364 raft_consensus.cc:3032] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:26.841504 15364 raft_consensus.cc:729] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:26.842198 15364 consensus_queue.cc:260] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.842569 15359 raft_consensus.cc:504] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:26.843480 15364 raft_consensus.cc:3037] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.846729 15359 leader_election.cc:288] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:26.847515 16093 raft_consensus.cc:2454] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:26.848419 15430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:26.849025 15405 leader_election.cc:302] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:26.849835 16787 raft_consensus.cc:2781] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:26.850330 16787 raft_consensus.cc:686] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:26.850382 15430 raft_consensus.cc:3032] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:26.850792 15509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab09a2671e654142a7a9d0078aff91ff" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:26.851388 15509 raft_consensus.cc:3037] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.851305 16787 consensus_queue.cc:237] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:26.858700 15509 raft_consensus.cc:2454] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:26.850840 15430 raft_consensus.cc:729] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:26.859977 15329 leader_election.cc:302] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:26.864919 15364 raft_consensus.cc:2454] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:26.865654 16827 raft_consensus.cc:2781] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:26.865053 15430 consensus_queue.cc:260] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:26.866145 16827 raft_consensus.cc:686] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:26.866801 15430 raft_consensus.cc:3037] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:26.867048 16827 consensus_queue.cc:237] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:26.865083 15262 catalog_manager.cc:5495] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:26.874912 15430 raft_consensus.cc:2454] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:26.886202 15261 catalog_manager.cc:5495] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:27.100675 15430 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:27.101867 16783 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:27.115177 15509 raft_consensus.cc:1261] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:27.117208 16783 consensus_queue.cc:1035] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:27.188956 15430 raft_consensus.cc:1261] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:27.190737 16827 consensus_queue.cc:1035] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:27.208811 15509 raft_consensus.cc:1261] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:27.210357 16777 consensus_queue.cc:1035] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:27.355197 15364 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:27.356240 16819 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:27.366279 16093 raft_consensus.cc:1261] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:27.367930 16819 consensus_queue.cc:1035] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:27.403311 15509 raft_consensus.cc:1261] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:27.404476 16777 consensus_queue.cc:1035] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:27.428018 15437 raft_consensus.cc:1261] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:27.432260 16781 consensus_queue.cc:1035] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:27.692195 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:27.744081 15364 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2454e1272e994181a08e49e54473af7a"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:27.744691 15364 raft_consensus.cc:595] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:27.747100 15437 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8351697a268a4337843da29ee5afac70"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:27.747668 15437 raft_consensus.cc:595] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Received request to transfer leadership to TS adf4734bb02e4108b00fabc552483a18
I20260929 11:36:27.750316 15364 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:27.750859 15364 raft_consensus.cc:595] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:27.751951 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260929 11:36:27.753505 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:27.754022 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:27.763135 15364 consensus_queue.cc:237] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
W20260929 11:36:27.772786 15330 consensus_peers.cc:487] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb49a87a20fe49448ce6bec0ace3573f. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:27.772933 16860 raft_consensus.cc:979] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:27.773526 16781 raft_consensus.cc:1067] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:27.773779 15509 raft_consensus.cc:1261] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:27.775336 15437 raft_consensus.cc:1261] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:27.775519 15430 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:27.776083 15430 raft_consensus.cc:482] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:27.776437 15430 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:27.777383 16781 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:27.778295 16860 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:27.782891 15430 raft_consensus.cc:504] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:27.784839 15430 leader_election.cc:288] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:27.789112 16860 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:27.790823 15437 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:27.791710 16093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:27.796236 16093 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:27.791733 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:27.798278 15364 raft_consensus.cc:3032] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:27.798556 15364 raft_consensus.cc:729] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:27.796393 15509 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:27.807855 15259 catalog_manager.cc:5495] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:27.811784 15364 consensus_queue.cc:260] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:27.813144 15364 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:27.814810 15437 consensus_queue.cc:237] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:27.827989 15509 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:27.829483 15359 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:27.830335 16819 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260929 11:36:27.832845 15405 consensus_peers.cc:487] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f77752fd0284cd5acb4a8de83942962. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:27.833415 16819 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260929 11:36:27.850076 16093 raft_consensus.cc:2454] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:27.850936 16096 raft_consensus.cc:1226] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Rejecting Update request from peer 79f6b689389549ce8079ff46fd514467 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:27.853704 16860 raft_consensus.cc:979] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:27.854194 16860 raft_consensus.cc:1067] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:27.857824 15364 raft_consensus.cc:2454] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:27.858659 15430 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2454e1272e994181a08e49e54473af7a"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:27.859308 15405 leader_election.cc:302] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:27.860654 15430 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:27.860912 16819 raft_consensus.cc:2781] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:27.861038 15430 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:27.867156 15430 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:27.868594 16819 raft_consensus.cc:686] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:27.869529 16819 consensus_queue.cc:237] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:27.869827 16787 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:27.876147 15364 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:27.883255 15430 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 4 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:27.884431 16093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:27.885052 16093 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:27.885782 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:27.886579 15359 raft_consensus.cc:3032] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:36:27.886952 15359 raft_consensus.cc:729] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:27.890064 15509 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:27.891752 16093 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 4.
I20260929 11:36:27.887899 15359 consensus_queue.cc:260] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:27.896068 15405 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:27.896919 15359 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:27.897399 16854 raft_consensus.cc:2781] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:36:27.897902 16854 raft_consensus.cc:686] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 4 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:27.898747 16854 consensus_queue.cc:237] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:27.915206 15359 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 4.
I20260929 11:36:27.923025 15259 catalog_manager.cc:5495] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:27.965338 15261 catalog_manager.cc:5495] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:27.982748 15359 consensus_queue.cc:237] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
W20260929 11:36:27.996470 15330 consensus_peers.cc:487] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3076393f65ab418199a711fc32bd3818. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:27.998209 15509 raft_consensus.cc:1261] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:27.999657 15430 raft_consensus.cc:1261] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:27.999907 15261 catalog_manager.cc:5495] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 3 to 4, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 4 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:28.001619 16859 consensus_queue.cc:1035] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:28.002388 16860 consensus_queue.cc:1035] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:28.012038 16781 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:28.013046 15437 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:28.017524 15509 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:28.030712 15259 catalog_manager.cc:5495] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:28.031388 15437 consensus_queue.cc:237] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.043147 15359 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260929 11:36:28.043295 15405 consensus_peers.cc:487] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 282bceebd7ed425db943d6b72f2513a1. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:28.044745 15509 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260929 11:36:28.044546 16876 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:28.045888 16875 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:28.062918 16854 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:28.064667 15509 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:28.075201 16873 raft_consensus.cc:979] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:28.075654 16873 raft_consensus.cc:1067] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Signalling peer adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:28.080470 15507 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8351697a268a4337843da29ee5afac70"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:47196
I20260929 11:36:28.081074 15507 raft_consensus.cc:482] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:28.081424 15507 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:28.083122 15261 catalog_manager.cc:5495] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 4, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 3 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:28.088496 15507 raft_consensus.cc:504] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:28.094923 15507 leader_election.cc:288] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 3 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:28.096515 16093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:28.096922 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8351697a268a4337843da29ee5afac70" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:28.097128 16093 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:28.097482 15437 raft_consensus.cc:3032] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:28.097780 15437 raft_consensus.cc:729] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:28.080826 15364 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:28.099334 15437 consensus_queue.cc:260] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:28.100780 15437 raft_consensus.cc:3037] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:28.108116 15437 raft_consensus.cc:2454] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 3.
I20260929 11:36:28.110637 15478 leader_election.cc:302] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:28.111424 16811 raft_consensus.cc:2781] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:28.111931 16811 raft_consensus.cc:686] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 3 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:28.112720 16811 consensus_queue.cc:237] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:28.138540 16093 raft_consensus.cc:2454] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 3.
I20260929 11:36:28.158066 15261 catalog_manager.cc:5495] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 2 to 3, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 3 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:28.338060 16885 ts_tablet_manager.cc:927] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:28.339740 16885 tablet_copy_client.cc:316] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:28.341116 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet bb49a87a20fe49448ce6bec0ace3573f from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:28.341667 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet bb49a87a20fe49448ce6bec0ace3573f from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-bb49a87a20fe49448ce6bec0ace3573f
I20260929 11:36:28.348001 15374 tablet_copy_source_session.cc:205] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:28.350899 16885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb49a87a20fe49448ce6bec0ace3573f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:28.363822 16885 tablet_copy_client.cc:791] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:28.364413 16885 tablet_copy_client.cc:655] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:28.368046 16885 tablet_copy_client.cc:531] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:28.376230 16885 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:28.392107 15364 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 4 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260929 11:36:28.394236 16854 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 11:36:28.417335 16885 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:28.418241 16885 tablet_bootstrap.cc:492] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:28.422646 16093 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 4 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260929 11:36:28.422960 16885 ts_tablet_manager.cc:1397] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.047s user 0.021s sys 0.004s
I20260929 11:36:28.425935 16885 raft_consensus.cc:348] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.426857 16885 raft_consensus.cc:729] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:28.427484 16885 consensus_queue.cc:260] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.429390 16876 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 11:36:28.431681 16885 ts_tablet_manager.cc:1428] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260929 11:36:28.433123 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-bb49a87a20fe49448ce6bec0ace3573f received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:28.437059 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-bb49a87a20fe49448ce6bec0ace3573f on tablet bb49a87a20fe49448ce6bec0ace3573f with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:28.440834 16096 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:28.449766 16854 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:28.455547 16892 ts_tablet_manager.cc:927] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:28.455669 16893 ts_tablet_manager.cc:927] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:28.497191 15364 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:28.504647 16893 tablet_copy_client.cc:316] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:28.505318 16872 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:28.522786 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 3076393f65ab418199a711fc32bd3818 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:28.528134 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 3076393f65ab418199a711fc32bd3818 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-3076393f65ab418199a711fc32bd3818
I20260929 11:36:28.559089 15374 tablet_copy_source_session.cc:205] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:28.585551 16885 ts_tablet_manager.cc:927] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:28.588097 16892 tablet_copy_client.cc:316] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:28.588600 16893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3076393f65ab418199a711fc32bd3818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:28.591060 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 0f77752fd0284cd5acb4a8de83942962 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:28.591624 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 0f77752fd0284cd5acb4a8de83942962 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-0f77752fd0284cd5acb4a8de83942962
I20260929 11:36:28.606734 15449 tablet_copy_source_session.cc:205] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:28.609894 16885 tablet_copy_client.cc:316] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:28.615980 15449 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet 282bceebd7ed425db943d6b72f2513a1 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:28.616569 15449 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet 282bceebd7ed425db943d6b72f2513a1 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-282bceebd7ed425db943d6b72f2513a1
I20260929 11:36:28.621290 16892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f77752fd0284cd5acb4a8de83942962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:28.628270 16096 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260929 11:36:28.629801 16811 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 11:36:28.639581 16892 tablet_copy_client.cc:791] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:28.640215 16892 tablet_copy_client.cc:655] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:28.643589 15449 tablet_copy_source_session.cc:205] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:28.653656 16885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 282bceebd7ed425db943d6b72f2513a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:28.654345 15437 raft_consensus.cc:1261] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260929 11:36:28.656958 16883 consensus_queue.cc:1035] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 11:36:28.644351 16893 tablet_copy_client.cc:791] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:28.666447 16892 tablet_copy_client.cc:531] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:28.658941 16893 tablet_copy_client.cc:655] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:28.693912 16893 tablet_copy_client.cc:531] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:28.703255 16892 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:28.707626 16893 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:28.740969 16893 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:28.741899 16893 tablet_bootstrap.cc:492] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:28.741990 16892 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:28.742583 16893 ts_tablet_manager.cc:1397] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.035s user 0.015s sys 0.011s
I20260929 11:36:28.742877 16892 tablet_bootstrap.cc:492] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:28.744493 16892 ts_tablet_manager.cc:1397] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.041s user 0.015s sys 0.017s
I20260929 11:36:28.749243 16892 raft_consensus.cc:348] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.750514 16892 raft_consensus.cc:729] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:28.751142 16892 consensus_queue.cc:260] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.754343 16892 ts_tablet_manager.cc:1428] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260929 11:36:28.757274 16893 raft_consensus.cc:348] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.757985 16885 tablet_copy_client.cc:791] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:28.758165 16893 raft_consensus.cc:729] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:28.759047 16885 tablet_copy_client.cc:655] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:28.759001 16893 consensus_queue.cc:260] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.761234 16893 ts_tablet_manager.cc:1428] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.018s user 0.006s sys 0.002s
I20260929 11:36:28.762665 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-3076393f65ab418199a711fc32bd3818 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:28.763007 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-3076393f65ab418199a711fc32bd3818 on tablet 3076393f65ab418199a711fc32bd3818 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:28.765537 15448 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-0f77752fd0284cd5acb4a8de83942962 received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:28.765956 15448 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-0f77752fd0284cd5acb4a8de83942962 on tablet 0f77752fd0284cd5acb4a8de83942962 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:28.767966 16885 tablet_copy_client.cc:531] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:28.775305 16885 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:28.799574 16885 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:28.800508 16885 tablet_bootstrap.cc:492] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:28.801600 16885 ts_tablet_manager.cc:1397] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.027s user 0.021s sys 0.005s
I20260929 11:36:28.803866 16885 raft_consensus.cc:348] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.804579 16885 raft_consensus.cc:729] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:28.805083 16885 consensus_queue.cc:260] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:28.807709 16885 ts_tablet_manager.cc:1428] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260929 11:36:28.809796 15448 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-282bceebd7ed425db943d6b72f2513a1 received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:28.810222 15448 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-282bceebd7ed425db943d6b72f2513a1 on tablet 282bceebd7ed425db943d6b72f2513a1 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:28.815057 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:28.864655 15430 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:28.865268 15430 raft_consensus.cc:595] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
I20260929 11:36:28.868134 15507 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:55996
I20260929 11:36:28.868819 15507 raft_consensus.cc:595] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
I20260929 11:36:28.870102 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260929 11:36:28.871770 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:28.872512 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:28.899943 16097 raft_consensus.cc:1203] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260929 11:36:28.927564 16097 raft_consensus.cc:1203] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:28.949007 16776 raft_consensus.cc:979] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:28.949453 16883 raft_consensus.cc:1067] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:28.950876 15355 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41838
I20260929 11:36:28.951502 15355 raft_consensus.cc:482] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:28.951937 15355 raft_consensus.cc:3037] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:28.957861 15355 raft_consensus.cc:504] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:28.961992 16097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:28.962582 16097 raft_consensus.cc:3037] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:28.964831 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e96d6ce3c2da47089d889e3b488fb3b8" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:28.965267 15507 raft_consensus.cc:3032] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:28.965456 15507 raft_consensus.cc:729] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:28.966032 15507 consensus_queue.cc:260] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:28.966756 15507 raft_consensus.cc:3037] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:28.972040 16097 raft_consensus.cc:2454] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:28.973263 15507 raft_consensus.cc:2454] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:28.974898 15330 leader_election.cc:302] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:28.975397 15355 leader_election.cc:288] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Requested vote from peers adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:28.976708 16859 raft_consensus.cc:2781] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:28.977774 16859 raft_consensus.cc:686] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:28.978470 16859 consensus_queue.cc:237] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:28.991889 15261 catalog_manager.cc:5495] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 1 to 2, leader changed from adf4734bb02e4108b00fabc552483a18 (127.13.221.195) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:29.038952 16097 raft_consensus.cc:1203] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:29.048955 16854 raft_consensus.cc:979] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:29.049472 16854 raft_consensus.cc:1067] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:29.051754 15359 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41834
I20260929 11:36:29.052291 15359 raft_consensus.cc:482] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:29.052676 15359 raft_consensus.cc:3037] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:29.058687 15359 raft_consensus.cc:504] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:29.060420 15359 leader_election.cc:288] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:29.062323 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:29.062934 15507 raft_consensus.cc:3037] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:29.065578 15438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34b22fc778c04f25b5b0fe1635280e0c" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:29.066231 15438 raft_consensus.cc:3032] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:29.066566 15438 raft_consensus.cc:729] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:29.070261 15507 raft_consensus.cc:2454] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:29.071584 15438 consensus_queue.cc:260] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:29.072467 15329 leader_election.cc:302] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:29.073108 15438 raft_consensus.cc:3037] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:29.073258 16859 raft_consensus.cc:2781] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:29.073876 16859 raft_consensus.cc:686] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:29.074707 16859 consensus_queue.cc:237] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:29.080631 15438 raft_consensus.cc:2454] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 2.
I20260929 11:36:29.089207 15259 catalog_manager.cc:5495] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:29.144536 16096 raft_consensus.cc:1203] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20260929 11:36:29.291203 16854 raft_consensus.cc:1050] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:29.293558 16854 consensus_queue.cc:237] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:29.299348 16096 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:29.300444 16787 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:29.303169 15510 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:29.303241 15359 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:29.304284 16876 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:29.306934 16876 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:29.311959 16787 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.317101 15364 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.322041 15510 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.331089 15259 catalog_manager.cc:5495] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:29.331135 16096 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.367141 15438 consensus_queue.cc:237] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:29.374879 16096 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:29.375237 15364 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:29.376230 16916 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:29.378058 16916 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:29.382555 16854 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.383857 16096 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.395722 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 0f77752fd0284cd5acb4a8de83942962 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:29.399297 15259 catalog_manager.cc:5495] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 4 to 5, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.402467 15355 raft_consensus.cc:2932] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.414980 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f77752fd0284cd5acb4a8de83942962 with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:29.418516 16920 tablet_replica.cc:330] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:29.419523 16920 raft_consensus.cc:2229] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:29.420409 16920 raft_consensus.cc:2258] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:29.425061 16920 ts_tablet_manager.cc:1905] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:29.429353 15510 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:29.430923 16859 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:29.440454 16920 ts_tablet_manager.cc:1918] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260929 11:36:29.440903 16920 log.cc:1196] T 0f77752fd0284cd5acb4a8de83942962 P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/0f77752fd0284cd5acb4a8de83942962
I20260929 11:36:29.442620 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 0f77752fd0284cd5acb4a8de83942962 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:29.457834 16096 raft_consensus.cc:1261] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:29.459152 16860 consensus_queue.cc:1035] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:29.496030 16859 raft_consensus.cc:1050] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:29.498379 16859 consensus_queue.cc:237] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:29.558881 15510 raft_consensus.cc:1261] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:29.559177 15507 raft_consensus.cc:1261] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:29.558908 16097 raft_consensus.cc:1261] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:29.560285 15438 raft_consensus.cc:1261] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:29.561426 16928 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:29.563544 16781 consensus_queue.cc:1035] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:29.563014 16927 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:29.565510 16860 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:29.589382 16927 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.605993 15430 raft_consensus.cc:1261] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:29.608778 16860 consensus_queue.cc:1035] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:29.614249 16097 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.622601 15259 catalog_manager.cc:5495] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:29.631733 15507 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.635985 15430 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.654520 16859 raft_consensus.cc:1050] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:29.656570 15355 consensus_queue.cc:237] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:29.664455 15507 raft_consensus.cc:1261] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:29.665951 16927 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:29.668239 16854 raft_consensus.cc:1050] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:29.670770 16854 consensus_queue.cc:237] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:29.672739 16096 raft_consensus.cc:1261] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:29.673318 16928 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.675377 16781 consensus_queue.cc:1035] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:29.682387 15510 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.683754 16859 consensus_queue.cc:237] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:29.681627 16096 raft_consensus.cc:2932] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.702080 15262 catalog_manager.cc:5495] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.710247 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet bb49a87a20fe49448ce6bec0ace3573f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:29.720598 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet bb49a87a20fe49448ce6bec0ace3573f with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:29.723119 16096 raft_consensus.cc:1261] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:29.725733 15507 raft_consensus.cc:1261] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:29.727186 16781 consensus_queue.cc:1035] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:29.729929 16781 consensus_queue.cc:1035] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260929 11:36:29.735910 15437 raft_consensus.cc:1261] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:29.739156 16859 consensus_queue.cc:1035] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:29.756857 16093 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260929 11:36:29.757915 15509 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260929 11:36:29.758515 16876 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:29.759079 15364 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260929 11:36:29.760421 16916 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:29.762028 16938 tablet_replica.cc:330] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:29.763842 16787 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:29.789589 16938 raft_consensus.cc:2229] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:29.789748 16928 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.791960 16938 raft_consensus.cc:2258] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:29.796468 16938 ts_tablet_manager.cc:1905] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:29.804630 16787 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.808290 15364 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.818892 16097 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.827188 15507 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.834774 16938 ts_tablet_manager.cc:1918] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:29.835317 16938 log.cc:1196] T bb49a87a20fe49448ce6bec0ace3573f P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/bb49a87a20fe49448ce6bec0ace3573f
I20260929 11:36:29.837809 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet bb49a87a20fe49448ce6bec0ace3573f (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:29.847920 15431 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.852435 16096 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.861274 15509 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.855357 15259 catalog_manager.cc:5495] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 4 to 5, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:29.873241 15258 catalog_manager.cc:5495] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.892844 15355 consensus_queue.cc:237] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:29.901108 15509 raft_consensus.cc:1261] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:29.903357 16097 raft_consensus.cc:1261] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:29.903168 16928 consensus_queue.cc:1035] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:29.904958 16928 consensus_queue.cc:1035] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:29.913354 16928 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.914589 15431 consensus_queue.cc:237] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:29.920889 16097 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260929 11:36:29.920975 16093 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.922248 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:29.922353 16787 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260929 11:36:29.922161 15509 raft_consensus.cc:2932] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.929332 16876 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.930763 16096 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.939077 15261 catalog_manager.cc:5495] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.944562 15507 raft_consensus.cc:1261] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260929 11:36:29.945225 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 3076393f65ab418199a711fc32bd3818 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:29.949378 16787 consensus_queue.cc:1035] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 11:36:29.956619 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 282bceebd7ed425db943d6b72f2513a1 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:29.964828 15258 catalog_manager.cc:5495] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 5 to 6, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 3 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:29.969040 15509 raft_consensus.cc:2932] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:29.983795 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet 3076393f65ab418199a711fc32bd3818 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:29.984720 16938 tablet_replica.cc:330] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:29.987382 16938 raft_consensus.cc:2229] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:29.988121 16938 raft_consensus.cc:2258] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:29.992272 16938 ts_tablet_manager.cc:1905] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:30.000635 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet 282bceebd7ed425db943d6b72f2513a1 with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:30.002408 16945 tablet_replica.cc:330] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:30.003438 16945 raft_consensus.cc:2229] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:30.004256 16945 raft_consensus.cc:2258] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:30.008090 16945 ts_tablet_manager.cc:1905] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:30.022279 16938 ts_tablet_manager.cc:1918] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:30.022857 16938 log.cc:1196] T 3076393f65ab418199a711fc32bd3818 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/3076393f65ab418199a711fc32bd3818
I20260929 11:36:30.023674 16945 ts_tablet_manager.cc:1918] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260929 11:36:30.024178 16945 log.cc:1196] T 282bceebd7ed425db943d6b72f2513a1 P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/282bceebd7ed425db943d6b72f2513a1
I20260929 11:36:30.024767 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet 3076393f65ab418199a711fc32bd3818 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:30.025982 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet 282bceebd7ed425db943d6b72f2513a1 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:30.041563 15355 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:30.042117 15355 raft_consensus.cc:595] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:30.044279 15355 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6926107852c74f4aaf37989b571c292a"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:30.044816 15355 raft_consensus.cc:595] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:30.046883 15431 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:30.047405 15431 raft_consensus.cc:595] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Received request to transfer leadership to TS adf4734bb02e4108b00fabc552483a18
I20260929 11:36:30.048548 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260929 11:36:30.049844 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:30.050331 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:30.219055 16916 raft_consensus.cc:979] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:30.219537 16787 raft_consensus.cc:1067] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Signalling peer adf4734bb02e4108b00fabc552483a18 to start an election
I20260929 11:36:30.221024 15507 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
from {username='slave'} at 127.0.0.1:47196
I20260929 11:36:30.221534 15507 raft_consensus.cc:482] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:30.221890 15507 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:30.226984 15507 raft_consensus.cc:504] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:30.228473 15507 leader_election.cc:288] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:30.229169 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:30.229420 15430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "adf4734bb02e4108b00fabc552483a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:30.229806 15355 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:30.229947 15430 raft_consensus.cc:3032] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:30.230319 15430 raft_consensus.cc:729] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:30.230959 15430 consensus_queue.cc:260] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:30.232028 15430 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:30.237572 15430 raft_consensus.cc:2454] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:30.238418 15355 raft_consensus.cc:2454] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf4734bb02e4108b00fabc552483a18 in term 2.
I20260929 11:36:30.239566 15476 leader_election.cc:302] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:30.241158 16929 raft_consensus.cc:2781] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:30.241555 16929 raft_consensus.cc:686] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Becoming Leader. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:30.242277 16929 consensus_queue.cc:237] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:30.247440 16859 raft_consensus.cc:979] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:30.247949 16859 raft_consensus.cc:1067] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:30.252286 15430 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:30.252841 15430 raft_consensus.cc:482] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:30.253147 15430 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:30.255162 15258 catalog_manager.cc:5495] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 reported cstate change: term changed from 1 to 2, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to adf4734bb02e4108b00fabc552483a18 (127.13.221.195). New cstate: current_term: 2 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:30.259361 15430 raft_consensus.cc:504] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:30.261291 15430 leader_election.cc:288] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 4 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:30.261719 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:30.262600 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c811ec08bf7499f8b0fa3f8b34fb290" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:30.262954 15355 raft_consensus.cc:3032] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:36:30.263444 15507 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:30.263526 15355 raft_consensus.cc:729] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:30.264760 15355 consensus_queue.cc:260] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:30.265750 15355 raft_consensus.cc:3037] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:30.270011 15507 raft_consensus.cc:2454] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 4.
I20260929 11:36:30.271109 15404 leader_election.cc:302] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:30.271803 16787 raft_consensus.cc:2781] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:36:30.271783 15355 raft_consensus.cc:2454] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 4.
I20260929 11:36:30.272449 16787 raft_consensus.cc:686] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 4 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:30.273191 16787 consensus_queue.cc:237] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:30.282371 15258 catalog_manager.cc:5495] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 3 to 4, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 4 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:30.437238 16859 raft_consensus.cc:979] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:30.437758 16928 raft_consensus.cc:1067] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:30.439312 16093 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6926107852c74f4aaf37989b571c292a"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48220
I20260929 11:36:30.439828 16093 raft_consensus.cc:482] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:30.440127 16093 raft_consensus.cc:3037] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:30.445634 16093 raft_consensus.cc:504] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:30.447736 16093 leader_election.cc:288] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:30.448191 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926107852c74f4aaf37989b571c292a" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:30.448815 15507 raft_consensus.cc:3037] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:30.453451 15507 raft_consensus.cc:2454] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:30.454037 15355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6926107852c74f4aaf37989b571c292a" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:30.454628 15355 raft_consensus.cc:3032] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:30.454990 15355 raft_consensus.cc:729] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:30.455142 16062 leader_election.cc:302] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf4734bb02e4108b00fabc552483a18, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:30.455885 16783 raft_consensus.cc:2781] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:30.455725 15355 consensus_queue.cc:260] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:30.456982 16783 raft_consensus.cc:686] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:30.457051 15355 raft_consensus.cc:3037] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:30.457795 16783 consensus_queue.cc:237] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:30.462425 15355 raft_consensus.cc:2454] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 2.
I20260929 11:36:30.465792 15258 catalog_manager.cc:5495] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:30.742684 15355 raft_consensus.cc:1261] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 4 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:36:30.743822 16876 consensus_queue.cc:1035] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:30.758499 15509 raft_consensus.cc:1261] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 4 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260929 11:36:30.761364 16916 consensus_queue.cc:1035] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:30.797578 15430 raft_consensus.cc:1261] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:30.798641 16929 consensus_queue.cc:1035] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:30.808014 15355 raft_consensus.cc:1261] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:30.809329 16929 consensus_queue.cc:1035] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:30.943073 15507 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:30.944420 16783 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:30.944679 15355 raft_consensus.cc:1261] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:30.946004 16783 consensus_queue.cc:1035] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:31.060616 15507 consensus_queue.cc:237] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.066412 15431 raft_consensus.cc:1261] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:31.066566 15479 consensus_peers.cc:487] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4188ffe2fdb34c9f9b5349a5aeff90a3. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:31.066582 15364 raft_consensus.cc:1261] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:31.067830 16929 consensus_queue.cc:1035] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:31.068717 16776 consensus_queue.cc:1035] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:31.077046 16956 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.079074 15364 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.085007 15431 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.089697 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:31.095821 15430 consensus_queue.cc:237] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.097102 15261 catalog_manager.cc:5495] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.112165 15364 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:31.113641 16876 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:31.118259 15507 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:31.122803 16876 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260929 11:36:31.127573 15405 consensus_peers.cc:487] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbd4efefe8d54575b3b5575a504bb0a1. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:31.158308 16916 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.160053 15364 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.171828 15507 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.182950 15364 consensus_queue.cc:237] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.197896 15509 raft_consensus.cc:1261] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:31.197956 15259 catalog_manager.cc:5495] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.199687 15431 raft_consensus.cc:1261] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:31.201072 16927 consensus_queue.cc:1035] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260929 11:36:31.209040 15330 consensus_peers.cc:487] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5471502e24764effae2ab947ad5c8cb5. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:31.218442 16928 consensus_queue.cc:1035] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:31.220517 16859 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.223846 15437 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.233595 15507 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.242493 15364 consensus_queue.cc:237] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.243255 15258 catalog_manager.cc:5495] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260929 11:36:31.269382 15330 consensus_peers.cc:487] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a423a044a6d34d8d86e6a2009617a53c. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:31.270479 15509 raft_consensus.cc:1261] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:31.271816 16975 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:31.275393 15437 raft_consensus.cc:1261] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:31.277479 16975 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:31.280047 15430 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:31.280655 15430 raft_consensus.cc:595] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Received request to transfer leadership to TS 79f6b689389549ce8079ff46fd514467
I20260929 11:36:31.289013 16928 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.290650 15509 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.296983 15507 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e"
dest_uuid: "adf4734bb02e4108b00fabc552483a18"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:55996
I20260929 11:36:31.297627 15507 raft_consensus.cc:595] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:31.298949 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260929 11:36:31.300597 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:31.301225 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:31.309211 15259 catalog_manager.cc:5495] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.330016 15430 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:31.469375 16916 raft_consensus.cc:979] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:31.469875 16876 raft_consensus.cc:1067] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Signalling peer 79f6b689389549ce8079ff46fd514467 to start an election
I20260929 11:36:31.471124 15362 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
from {username='slave'} at 127.0.0.1:41834
I20260929 11:36:31.471596 15362 raft_consensus.cc:482] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:31.471896 15362 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:31.477370 15362 raft_consensus.cc:504] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:31.479092 15362 leader_election.cc:288] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 3 election: Requested vote from peers 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925), bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689)
I20260929 11:36:31.480039 16096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
I20260929 11:36:31.480141 15437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c9ca97877f48c9ba1c6a3503576624" candidate_uuid: "79f6b689389549ce8079ff46fd514467" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:31.480809 16096 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:31.480919 15437 raft_consensus.cc:3032] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:31.481280 15437 raft_consensus.cc:729] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:31.482183 15437 consensus_queue.cc:260] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:31.483398 15437 raft_consensus.cc:3037] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:31.487097 16096 raft_consensus.cc:2454] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 3.
I20260929 11:36:31.488144 15330 leader_election.cc:302] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:31.488907 16928 raft_consensus.cc:2781] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:31.489398 16928 raft_consensus.cc:686] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Becoming Leader. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:31.489552 15437 raft_consensus.cc:2454] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f6b689389549ce8079ff46fd514467 in term 3.
I20260929 11:36:31.490208 16928 consensus_queue.cc:237] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:31.508469 15261 catalog_manager.cc:5495] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 reported cstate change: term changed from 2 to 3, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to 79f6b689389549ce8079ff46fd514467 (127.13.221.193). New cstate: current_term: 3 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:31.537979 16981 ts_tablet_manager.cc:927] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:31.539765 16981 tablet_copy_client.cc:316] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:31.541196 15448 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet bbd4efefe8d54575b3b5575a504bb0a1 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:31.541730 15448 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet bbd4efefe8d54575b3b5575a504bb0a1 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-bbd4efefe8d54575b3b5575a504bb0a1
I20260929 11:36:31.552788 15448 tablet_copy_source_session.cc:205] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:31.556825 16981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbd4efefe8d54575b3b5575a504bb0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:31.582613 16983 ts_tablet_manager.cc:927] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:31.585131 16983 tablet_copy_client.cc:316] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:31.586504 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 5471502e24764effae2ab947ad5c8cb5 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:31.586923 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 5471502e24764effae2ab947ad5c8cb5 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-5471502e24764effae2ab947ad5c8cb5
I20260929 11:36:31.588011 16981 tablet_copy_client.cc:791] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:31.588610 16981 tablet_copy_client.cc:655] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:31.593237 15374 tablet_copy_source_session.cc:205] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:31.593781 16981 tablet_copy_client.cc:531] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:31.593920 16985 ts_tablet_manager.cc:927] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:31.596066 16983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5471502e24764effae2ab947ad5c8cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:31.598130 16985 tablet_copy_client.cc:316] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:31.600607 15522 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:31.601075 15522 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-4188ffe2fdb34c9f9b5349a5aeff90a3
I20260929 11:36:31.611670 16983 tablet_copy_client.cc:791] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:31.612249 16983 tablet_copy_client.cc:655] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:31.614724 15522 tablet_copy_source_session.cc:205] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:31.616725 16983 tablet_copy_client.cc:531] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:31.617899 16985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:31.619701 16981 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:31.627760 16983 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:31.657289 16981 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:31.658218 16981 tablet_bootstrap.cc:492] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:31.658895 16981 ts_tablet_manager.cc:1397] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.039s user 0.015s sys 0.012s
I20260929 11:36:31.661558 16981 raft_consensus.cc:348] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.664026 16981 raft_consensus.cc:729] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:31.667546 16981 consensus_queue.cc:260] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.670234 16983 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:31.670544 16981 ts_tablet_manager.cc:1428] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260929 11:36:31.677199 15448 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-bbd4efefe8d54575b3b5575a504bb0a1 received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:31.677639 15448 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-bbd4efefe8d54575b3b5575a504bb0a1 on tablet bbd4efefe8d54575b3b5575a504bb0a1 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:31.687893 16983 tablet_bootstrap.cc:492] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:31.688753 16983 ts_tablet_manager.cc:1397] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.061s user 0.021s sys 0.016s
I20260929 11:36:31.690697 16985 tablet_copy_client.cc:791] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:31.691267 16985 tablet_copy_client.cc:655] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:31.698756 16983 raft_consensus.cc:348] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.700165 16983 raft_consensus.cc:729] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:31.701033 16985 tablet_copy_client.cc:531] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:31.700877 16983 consensus_queue.cc:260] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.708775 16983 ts_tablet_manager.cc:1428] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20260929 11:36:31.710322 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-5471502e24764effae2ab947ad5c8cb5 received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:31.710700 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-5471502e24764effae2ab947ad5c8cb5 on tablet 5471502e24764effae2ab947ad5c8cb5 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:31.713840 16985 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:31.822677 16983 ts_tablet_manager.cc:927] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:31.863579 16983 tablet_copy_client.cc:316] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:31.866076 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet a423a044a6d34d8d86e6a2009617a53c from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:31.866570 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet a423a044a6d34d8d86e6a2009617a53c from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-a423a044a6d34d8d86e6a2009617a53c
I20260929 11:36:31.875443 15374 tablet_copy_source_session.cc:205] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:31.877032 16985 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:31.877959 16985 tablet_bootstrap.cc:492] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:31.878644 16985 ts_tablet_manager.cc:1397] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.165s user 0.015s sys 0.024s
I20260929 11:36:31.878927 16983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a423a044a6d34d8d86e6a2009617a53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:31.881451 16985 raft_consensus.cc:348] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.882375 16985 raft_consensus.cc:729] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:31.883020 16985 consensus_queue.cc:260] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.885859 16985 ts_tablet_manager.cc:1428] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260929 11:36:31.889997 15522 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-4188ffe2fdb34c9f9b5349a5aeff90a3 received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:31.890398 15522 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-4188ffe2fdb34c9f9b5349a5aeff90a3 on tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:31.891763 16956 raft_consensus.cc:979] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:31.892237 16956 raft_consensus.cc:1067] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:31.896855 15437 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49378
I20260929 11:36:31.897406 15437 raft_consensus.cc:482] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:31.897729 15437 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:31.904040 16983 tablet_copy_client.cc:791] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:31.904794 16983 tablet_copy_client.cc:655] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:31.904305 15437 raft_consensus.cc:504] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:31.906307 15437 leader_election.cc:288] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 3 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:31.907099 15364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:31.907341 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed8e53cca3ac4865ba0e4c18b7c9ad6e" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:31.909024 15507 raft_consensus.cc:3032] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:31.909341 15507 raft_consensus.cc:729] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adf4734bb02e4108b00fabc552483a18, State: Running, Role: LEADER
I20260929 11:36:31.907689 15364 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:31.912923 15507 consensus_queue.cc:260] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:31.913867 15507 raft_consensus.cc:3037] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:31.916227 15364 raft_consensus.cc:2454] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 3.
I20260929 11:36:31.917299 15402 leader_election.cc:302] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467; no voters:
I20260929 11:36:31.918041 16916 raft_consensus.cc:2781] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:31.918503 16916 raft_consensus.cc:686] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:31.919252 16916 consensus_queue.cc:237] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:31.925170 15507 raft_consensus.cc:2454] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 3.
I20260929 11:36:31.925777 16983 tablet_copy_client.cc:531] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:31.936093 16983 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:31.966512 15259 catalog_manager.cc:5495] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 2 to 3, leader changed from adf4734bb02e4108b00fabc552483a18 (127.13.221.195) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 3 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:31.979065 16983 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:31.979971 16983 tablet_bootstrap.cc:492] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:31.980618 16983 ts_tablet_manager.cc:1397] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.045s user 0.021s sys 0.004s
I20260929 11:36:31.983186 16983 raft_consensus.cc:348] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.984218 16983 raft_consensus.cc:729] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:31.984403 16096 raft_consensus.cc:1203] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:31.984892 16983 consensus_queue.cc:260] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:31.987339 16983 ts_tablet_manager.cc:1428] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260929 11:36:31.992229 15374 tablet_copy_service.cc:342] P 79f6b689389549ce8079ff46fd514467: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-a423a044a6d34d8d86e6a2009617a53c received from {username='slave'} at 127.0.0.1:32962
I20260929 11:36:31.992638 15374 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-a423a044a6d34d8d86e6a2009617a53c on tablet a423a044a6d34d8d86e6a2009617a53c with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:32.014150 16096 raft_consensus.cc:1203] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:32.077589 16096 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260929 11:36:32.077880 16093 raft_consensus.cc:1203] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260929 11:36:32.079694 16928 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 11:36:32.130630 15431 raft_consensus.cc:1261] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260929 11:36:32.136134 16928 consensus_queue.cc:1035] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260929 11:36:32.297981 16093 raft_consensus.cc:1203] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:32.348390 15507 raft_consensus.cc:1261] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:36:32.349529 16916 consensus_queue.cc:1035] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.359987 15362 raft_consensus.cc:1261] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260929 11:36:32.362876 16989 consensus_queue.cc:1035] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.371671 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:32.441323 15364 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd"
dest_uuid: "79f6b689389549ce8079ff46fd514467"
mode: GRACEFUL
new_leader_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:37276
I20260929 11:36:32.441928 15364 raft_consensus.cc:595] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Received request to transfer leadership to TS 2b2ed85c4da64515a0664b6c0421e078
I20260929 11:36:32.445297 15430 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2454e1272e994181a08e49e54473af7a"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:32.445781 15430 raft_consensus.cc:595] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 4 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:32.446777 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260929 11:36:32.448071 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:32.448638 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:32.544797 16994 raft_consensus.cc:1050] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:32.547348 16994 consensus_queue.cc:237] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.553576 16093 raft_consensus.cc:1261] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.553964 15431 raft_consensus.cc:1261] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.554865 15359 raft_consensus.cc:1261] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.555066 16776 consensus_queue.cc:1035] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.556222 16929 consensus_queue.cc:1035] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.557145 16956 consensus_queue.cc:1035] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.575740 16929 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.579175 15431 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.581427 16928 raft_consensus.cc:1050] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:32.583493 16928 consensus_queue.cc:237] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.595741 16093 raft_consensus.cc:1261] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.598353 16928 consensus_queue.cc:1035] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.598516 15431 raft_consensus.cc:1261] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.599927 16991 consensus_queue.cc:1035] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.608592 15505 raft_consensus.cc:1261] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.598488 15261 catalog_manager.cc:5495] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.611575 16928 consensus_queue.cc:1035] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.602509 15364 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.619431 16992 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.621093 15505 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.633224 16993 raft_consensus.cc:1050] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:32.635061 16096 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.635578 16993 consensus_queue.cc:237] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.637282 15437 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.645825 15259 catalog_manager.cc:5495] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:32.650022 16096 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.673331 15364 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:32.673331 16096 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:32.673616 15509 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260929 11:36:32.674866 16989 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:32.675688 16993 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:32.679524 16916 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:32.706415 15507 consensus_queue.cc:237] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.715500 15362 consensus_queue.cc:237] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.717257 16993 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.719260 15355 raft_consensus.cc:1261] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:32.719149 15364 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.720851 16929 consensus_queue.cc:1035] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:32.733139 16096 raft_consensus.cc:1261] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:32.738569 16994 consensus_queue.cc:1035] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:32.734826 16992 raft_consensus.cc:979] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467: : Instructing follower 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:32.741310 16992 raft_consensus.cc:1067] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Signalling peer 2b2ed85c4da64515a0664b6c0421e078 to start an election
I20260929 11:36:32.743594 16093 raft_consensus.cc:1261] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:32.743336 15359 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.745601 16991 consensus_queue.cc:1035] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:32.753805 16992 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.757750 15430 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
from {username='slave'} at 127.0.0.1:49370
I20260929 11:36:32.758481 15430 raft_consensus.cc:482] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:32.758531 15437 raft_consensus.cc:1261] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:32.758872 15430 raft_consensus.cc:3037] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:32.757566 16094 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.733889 16929 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.764987 16991 consensus_queue.cc:1035] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:32.769129 15437 raft_consensus.cc:2932] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.767740 15430 raft_consensus.cc:504] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:32.755437 16093 raft_consensus.cc:2932] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.777969 15262 catalog_manager.cc:5495] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.778822 15505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf4734bb02e4108b00fabc552483a18"
I20260929 11:36:32.779979 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5471502e24764effae2ab947ad5c8cb5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:32.780391 15505 raft_consensus.cc:3037] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:32.782894 15507 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.785017 16097 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.795943 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cf31b2803e34f7a9c2d7bdea21cc0bd" candidate_uuid: "2b2ed85c4da64515a0664b6c0421e078" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:32.796635 15362 raft_consensus.cc:3032] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:32.796929 15362 raft_consensus.cc:729] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79f6b689389549ce8079ff46fd514467, State: Running, Role: LEADER
I20260929 11:36:32.797878 15505 raft_consensus.cc:2454] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:32.798629 15430 leader_election.cc:288] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:32.797672 15362 consensus_queue.cc:260] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:32.800755 15404 leader_election.cc:302] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2ed85c4da64515a0664b6c0421e078, adf4734bb02e4108b00fabc552483a18; no voters:
I20260929 11:36:32.801023 15362 raft_consensus.cc:3037] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:32.801519 16916 raft_consensus.cc:2781] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:32.801982 16916 raft_consensus.cc:686] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:32.802830 16916 consensus_queue.cc:237] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } }
I20260929 11:36:32.813011 15362 raft_consensus.cc:2454] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2ed85c4da64515a0664b6c0421e078 in term 2.
I20260929 11:36:32.815063 16989 raft_consensus.cc:979] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:32.815529 16989 raft_consensus.cc:1067] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 4 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:32.823585 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:32.833913 15430 consensus_queue.cc:237] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.807433 15259 catalog_manager.cc:5495] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.845768 16096 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:32.848358 16972 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260929 11:36:32.848915 16093 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2454e1272e994181a08e49e54473af7a"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48212
I20260929 11:36:32.849537 16093 raft_consensus.cc:482] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:32.852028 16093 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:36:32.855944 16993 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.858105 16096 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.859727 16093 raft_consensus.cc:504] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.862471 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:32.863051 15362 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:36:32.864017 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet 5471502e24764effae2ab947ad5c8cb5 with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:32.864989 15262 catalog_manager.cc:5495] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 3 to 4, VOTER 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) evicted. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.877008 15362 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 5.
I20260929 11:36:32.879055 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 with delete_type TABLET_DATA_TOMBSTONED (TS 2b2ed85c4da64515a0664b6c0421e078 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49358
I20260929 11:36:32.880481 16060 leader_election.cc:302] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:32.880630 15431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2454e1272e994181a08e49e54473af7a" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:32.881203 15431 raft_consensus.cc:3032] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 4 LEADER]: Stepping down as leader of term 4
I20260929 11:36:32.881292 16093 leader_election.cc:288] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 5 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:32.881528 15431 raft_consensus.cc:729] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:32.882189 16961 raft_consensus.cc:2781] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:36:32.882738 16961 raft_consensus.cc:686] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 5 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:32.885277 17024 tablet_replica.cc:330] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:32.886499 17024 raft_consensus.cc:2229] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:32.888103 17024 raft_consensus.cc:2258] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:32.883806 16961 consensus_queue.cc:237] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.885905 15431 consensus_queue.cc:260] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.891011 16928 raft_consensus.cc:1050] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:32.891171 15431 raft_consensus.cc:3037] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:36:32.893407 16928 consensus_queue.cc:237] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:32.895588 15510 raft_consensus.cc:1261] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260929 11:36:32.898078 16989 consensus_queue.cc:1035] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260929 11:36:32.899823 15248 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet bbd4efefe8d54575b3b5575a504bb0a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:32.905534 17025 tablet_replica.cc:330] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:32.906514 15510 raft_consensus.cc:2932] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.907570 17025 raft_consensus.cc:2229] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:32.911077 17025 raft_consensus.cc:2258] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:32.911633 16096 raft_consensus.cc:1261] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.912375 15430 raft_consensus.cc:1261] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.912923 15509 raft_consensus.cc:1261] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:32.913717 16928 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.914638 16991 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.915463 16859 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:32.918960 17025 ts_tablet_manager.cc:1905] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:32.922775 17024 ts_tablet_manager.cc:1905] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:32.931754 15259 catalog_manager.cc:5495] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index 4 to 5, VOTER 79f6b689389549ce8079ff46fd514467 (127.13.221.193) evicted. New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:32.946740 16859 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.950524 15259 catalog_manager.cc:5495] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: term changed from 1 to 2, leader changed from 79f6b689389549ce8079ff46fd514467 (127.13.221.193) to 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194). New cstate: current_term: 2 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:32.958459 15437 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.948241 17025 ts_tablet_manager.cc:1918] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:32.964339 17025 log.cc:1196] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 2b2ed85c4da64515a0664b6c0421e078: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/wals/4188ffe2fdb34c9f9b5349a5aeff90a3
I20260929 11:36:32.956141 15431 raft_consensus.cc:2454] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 5.
I20260929 11:36:32.967231 15248 catalog_manager.cc:4841] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): tablet 4188ffe2fdb34c9f9b5349a5aeff90a3 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:32.981983 16096 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:32.985307 17024 ts_tablet_manager.cc:1918] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:32.985826 17024 log.cc:1196] T 5471502e24764effae2ab947ad5c8cb5 P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/5471502e24764effae2ab947ad5c8cb5
I20260929 11:36:32.987478 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet 5471502e24764effae2ab947ad5c8cb5 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:32.988843 15258 catalog_manager.cc:5495] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 4 to 5, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 5 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:33.004637 15353 tablet_service.cc:1514] Processing DeleteTablet for tablet bbd4efefe8d54575b3b5575a504bb0a1 with delete_type TABLET_DATA_TOMBSTONED (TS 79f6b689389549ce8079ff46fd514467 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41830
I20260929 11:36:33.006649 17032 tablet_replica.cc:330] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:33.007704 17032 raft_consensus.cc:2229] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:33.008420 17032 raft_consensus.cc:2258] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:33.015810 17032 ts_tablet_manager.cc:1905] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:33.017520 15259 catalog_manager.cc:5495] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:33.022447 15510 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } attrs { replace: true } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:33.029716 15359 consensus_queue.cc:237] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:33.039577 15437 raft_consensus.cc:1261] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:33.039564 16096 raft_consensus.cc:1261] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260929 11:36:33.041808 16991 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260929 11:36:33.043289 16859 consensus_queue.cc:1035] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260929 11:36:33.055696 17032 ts_tablet_manager.cc:1918] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260929 11:36:33.056368 17032 log.cc:1196] T bbd4efefe8d54575b3b5575a504bb0a1 P 79f6b689389549ce8079ff46fd514467: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/wals/bbd4efefe8d54575b3b5575a504bb0a1
I20260929 11:36:33.055684 16928 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:33.058226 16093 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:33.062813 15246 catalog_manager.cc:4841] TS 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): tablet bbd4efefe8d54575b3b5575a504bb0a1 (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:33.071128 15246 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a423a044a6d34d8d86e6a2009617a53c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260929 11:36:33.074218 15258 catalog_manager.cc:5495] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:33.078167 15437 raft_consensus.cc:2932] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adf4734bb02e4108b00fabc552483a18 (127.13.221.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:33.092741 15495 tablet_service.cc:1514] Processing DeleteTablet for tablet a423a044a6d34d8d86e6a2009617a53c with delete_type TABLET_DATA_TOMBSTONED (TS adf4734bb02e4108b00fabc552483a18 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47180
I20260929 11:36:33.094080 17024 tablet_replica.cc:330] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:33.095095 17024 raft_consensus.cc:2229] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:33.095829 17024 raft_consensus.cc:2258] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:33.098994 17024 ts_tablet_manager.cc:1905] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260929 11:36:33.111395 17024 ts_tablet_manager.cc:1918] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260929 11:36:33.111683 17024 log.cc:1196] T a423a044a6d34d8d86e6a2009617a53c P adf4734bb02e4108b00fabc552483a18: Deleting WAL directory at /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/wals/a423a044a6d34d8d86e6a2009617a53c
I20260929 11:36:33.113013 15248 catalog_manager.cc:4841] TS adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): tablet a423a044a6d34d8d86e6a2009617a53c (table test-workload [id=1cc23d5454934479b89978cacbfee484]) successfully deleted
I20260929 11:36:33.291407 15507 raft_consensus.cc:1261] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:33.293576 15431 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 5 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260929 11:36:33.294565 16916 consensus_queue.cc:1035] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:33.295090 17031 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260929 11:36:33.298692 15359 raft_consensus.cc:1261] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 5 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260929 11:36:33.306967 17031 consensus_queue.cc:1035] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260929 11:36:33.330781 15362 raft_consensus.cc:1261] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:33.333604 16972 consensus_queue.cc:1035] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:33.503813 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:33.539120 15431 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962"
dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
mode: GRACEFUL
new_leader_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:38672
I20260929 11:36:33.539646 15431 raft_consensus.cc:595] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Received request to transfer leadership to TS bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:33.540652 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260929 11:36:33.541697 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:33.542179 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:33.849237 16993 raft_consensus.cc:979] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: : Instructing follower bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:33.849749 17042 raft_consensus.cc:1067] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Signalling peer bf69c081fbc04bb398d116939cc78f21 to start an election
I20260929 11:36:33.851351 16093 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962"
dest_uuid: "bf69c081fbc04bb398d116939cc78f21"
from {username='slave'} at 127.0.0.1:48212
I20260929 11:36:33.851872 16093 raft_consensus.cc:482] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260929 11:36:33.852147 16093 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:33.857685 16093 raft_consensus.cc:504] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:33.861711 15359 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "79f6b689389549ce8079ff46fd514467"
I20260929 11:36:33.862308 15359 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:33.863211 16093 leader_election.cc:288] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 election: Requested vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:33.864343 15431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f77752fd0284cd5acb4a8de83942962" candidate_uuid: "bf69c081fbc04bb398d116939cc78f21" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2b2ed85c4da64515a0664b6c0421e078"
I20260929 11:36:33.864995 15431 raft_consensus.cc:3032] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:33.865715 15431 raft_consensus.cc:729] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b2ed85c4da64515a0664b6c0421e078, State: Running, Role: LEADER
I20260929 11:36:33.867508 15431 consensus_queue.cc:260] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:33.868762 15431 raft_consensus.cc:3037] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:33.869549 15359 raft_consensus.cc:2454] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 3.
I20260929 11:36:33.870678 16060 leader_election.cc:302] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79f6b689389549ce8079ff46fd514467, bf69c081fbc04bb398d116939cc78f21; no voters:
I20260929 11:36:33.871804 17031 raft_consensus.cc:2781] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:33.872239 17031 raft_consensus.cc:686] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 3 LEADER]: Becoming Leader. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Running, Role: LEADER
I20260929 11:36:33.872991 17031 consensus_queue.cc:237] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:33.874864 15431 raft_consensus.cc:2454] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf69c081fbc04bb398d116939cc78f21 in term 3.
I20260929 11:36:33.887266 15258 catalog_manager.cc:5495] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: term changed from 2 to 3, leader changed from 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194) to bf69c081fbc04bb398d116939cc78f21 (127.13.221.196). New cstate: current_term: 3 leader_uuid: "bf69c081fbc04bb398d116939cc78f21" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260929 11:36:34.140949 15431 consensus_queue.cc:237] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:34.149473 15507 raft_consensus.cc:1261] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:34.150802 15362 raft_consensus.cc:1261] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260929 11:36:34.150835 15405 consensus_peers.cc:487] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5a187e4fe114b97b83228cf0177ca13. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:34.150998 16993 consensus_queue.cc:1035] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:34.152184 17042 consensus_queue.cc:1035] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:34.159451 17042 raft_consensus.cc:2932] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.161528 15507 raft_consensus.cc:2932] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.164126 15362 raft_consensus.cc:2932] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.177240 15258 catalog_manager.cc:5495] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:34.178148 15359 consensus_queue.cc:237] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
W20260929 11:36:34.197549 15330 consensus_peers.cc:487] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34b22fc778c04f25b5b0fe1635280e0c. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:34.198347 15507 raft_consensus.cc:1261] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:34.199455 15431 raft_consensus.cc:1261] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260929 11:36:34.199604 16992 consensus_queue.cc:1035] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:34.200776 16928 consensus_queue.cc:1035] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:36:34.210139 16928 raft_consensus.cc:2932] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.217679 15509 raft_consensus.cc:2932] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.230700 15510 consensus_queue.cc:237] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:34.231801 15258 catalog_manager.cc:5495] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 2 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:34.242239 15431 raft_consensus.cc:2932] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.265599 15431 raft_consensus.cc:1261] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:34.266212 15359 raft_consensus.cc:1261] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:34.267689 16776 consensus_queue.cc:1035] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260929 11:36:34.331434 15479 consensus_peers.cc:487] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8119561598f743b799cb3b1843a3507f. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:34.335377 17043 consensus_queue.cc:1035] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:34.349736 15431 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260929 11:36:34.356774 16961 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260929 11:36:34.388913 17043 raft_consensus.cc:2932] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
W20260929 11:36:34.402592 16060 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 44373.9us
I20260929 11:36:34.408670 15364 raft_consensus.cc:2932] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.415416 15438 raft_consensus.cc:2932] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.428067 15362 raft_consensus.cc:1261] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Refusing update from remote peer bf69c081fbc04bb398d116939cc78f21: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260929 11:36:34.432633 15359 consensus_queue.cc:237] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:34.433939 15259 catalog_manager.cc:5495] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "adf4734bb02e4108b00fabc552483a18" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:34.438292 17031 consensus_queue.cc:1035] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260929 11:36:34.522559 15510 raft_consensus.cc:1261] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:34.524716 16928 consensus_queue.cc:1035] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260929 11:36:34.527323 15330 consensus_peers.cc:487] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 -> Peer bf69c081fbc04bb398d116939cc78f21 (127.13.221.196:39689): Couldn't send request to peer bf69c081fbc04bb398d116939cc78f21. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70d952461bcb418b8e68f4389e815978. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:34.527784 15431 raft_consensus.cc:1261] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Refusing update from remote peer 79f6b689389549ce8079ff46fd514467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260929 11:36:34.533219 16928 consensus_queue.cc:1035] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:34.537132 16992 raft_consensus.cc:2932] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.542450 15509 raft_consensus.cc:2932] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.578125 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:34.621706 15438 raft_consensus.cc:2932] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } }
I20260929 11:36:34.701511 15259 catalog_manager.cc:5495] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 reported cstate change: config changed from index -1 to 2, NON_VOTER bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) added. New cstate: current_term: 1 leader_uuid: "79f6b689389549ce8079ff46fd514467" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:34.749727 17077 ts_tablet_manager.cc:927] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:34.797446 17078 ts_tablet_manager.cc:927] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:34.829514 17077 tablet_copy_client.cc:316] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:34.831645 15374 tablet_copy_service.cc:140] P 79f6b689389549ce8079ff46fd514467: Received BeginTabletCopySession request for tablet 34b22fc778c04f25b5b0fe1635280e0c from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:32962)
I20260929 11:36:34.832137 15374 tablet_copy_service.cc:161] P 79f6b689389549ce8079ff46fd514467: Beginning new tablet copy session on tablet 34b22fc778c04f25b5b0fe1635280e0c from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:32962: session id = bf69c081fbc04bb398d116939cc78f21-34b22fc778c04f25b5b0fe1635280e0c
I20260929 11:36:34.838452 17079 ts_tablet_manager.cc:927] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:34.840888 17079 tablet_copy_client.cc:316] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.195:37107
I20260929 11:36:34.841189 15374 tablet_copy_source_session.cc:205] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:34.842819 15522 tablet_copy_service.cc:140] P adf4734bb02e4108b00fabc552483a18: Received BeginTabletCopySession request for tablet 8119561598f743b799cb3b1843a3507f from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:55836)
I20260929 11:36:34.843379 15522 tablet_copy_service.cc:161] P adf4734bb02e4108b00fabc552483a18: Beginning new tablet copy session on tablet 8119561598f743b799cb3b1843a3507f from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:55836: session id = bf69c081fbc04bb398d116939cc78f21-8119561598f743b799cb3b1843a3507f
I20260929 11:36:34.850149 17077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34b22fc778c04f25b5b0fe1635280e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:34.852809 17078 tablet_copy_client.cc:316] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.194:33925
I20260929 11:36:34.862026 15448 tablet_copy_service.cc:140] P 2b2ed85c4da64515a0664b6c0421e078: Received BeginTabletCopySession request for tablet d5a187e4fe114b97b83228cf0177ca13 from peer bf69c081fbc04bb398d116939cc78f21 ({username='slave'} at 127.0.0.1:36114)
I20260929 11:36:34.862629 15448 tablet_copy_service.cc:161] P 2b2ed85c4da64515a0664b6c0421e078: Beginning new tablet copy session on tablet d5a187e4fe114b97b83228cf0177ca13 from peer bf69c081fbc04bb398d116939cc78f21 at {username='slave'} at 127.0.0.1:36114: session id = bf69c081fbc04bb398d116939cc78f21-d5a187e4fe114b97b83228cf0177ca13
I20260929 11:36:34.871999 15448 tablet_copy_source_session.cc:205] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:34.879580 17078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5a187e4fe114b97b83228cf0177ca13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:34.888922 14199 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260929 11:36:34.856134 15522 tablet_copy_source_session.cc:205] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: Tablet Copy: opened 0 blocks and 1 log segments
I20260929 11:36:34.891115 14199 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260929 11:36:34.891754 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:34.892912 17079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8119561598f743b799cb3b1843a3507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:34.910404 17078 tablet_copy_client.cc:791] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:34.911201 17078 tablet_copy_client.cc:655] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:34.917079 17077 tablet_copy_client.cc:791] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:34.917376 17078 tablet_copy_client.cc:531] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:34.917879 17077 tablet_copy_client.cc:655] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:34.926366 17077 tablet_copy_client.cc:531] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:34.927907 17078 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:34.931221 17079 tablet_copy_client.cc:791] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 0 data blocks...
I20260929 11:36:34.932004 17079 tablet_copy_client.cc:655] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: tablet copy: Starting download of 1 WAL segments...
I20260929 11:36:34.951108 17077 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:34.952450 17079 tablet_copy_client.cc:531] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260929 11:36:34.966432 14199 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260929 11:36:34.973330 17078 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:34.974524 17078 tablet_bootstrap.cc:492] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:34.975446 17078 ts_tablet_manager.cc:1397] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.048s user 0.027s sys 0.009s
I20260929 11:36:34.979456 17079 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: Bootstrap starting.
I20260929 11:36:34.983223 17078 raft_consensus.cc:348] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:34.985597 17078 raft_consensus.cc:729] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:34.986439 17078 consensus_queue.cc:260] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:35.008203 17078 ts_tablet_manager.cc:1428] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.032s user 0.007s sys 0.001s
I20260929 11:36:35.015089 15448 tablet_copy_service.cc:342] P 2b2ed85c4da64515a0664b6c0421e078: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-d5a187e4fe114b97b83228cf0177ca13 received from {username='slave'} at 127.0.0.1:36114
I20260929 11:36:35.015514 15448 tablet_copy_service.cc:433] P 2b2ed85c4da64515a0664b6c0421e078: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-d5a187e4fe114b97b83228cf0177ca13 on tablet d5a187e4fe114b97b83228cf0177ca13 with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:35.034808 17078 ts_tablet_manager.cc:927] T 70d952461bcb418b8e68f4389e815978 P bf69c081fbc04bb398d116939cc78f21: Initiating tablet copy from peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849)
I20260929 11:36:35.036866 14199 tablet_server.cc:178] TabletServer@127.13.221.193:0 shutting down...
I20260929 11:36:35.051748 17077 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:35.053085 17077 tablet_bootstrap.cc:492] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:35.053910 17077 ts_tablet_manager.cc:1397] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.103s user 0.023s sys 0.008s
W20260929 11:36:35.054208 15246 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260929 11:36:35.057170 17077 raft_consensus.cc:348] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:35.058403 17077 raft_consensus.cc:729] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:35.059137 17077 consensus_queue.cc:260] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } attrs { replace: true } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:35.062307 14199 tablet_copy_service.cc:362] P 79f6b689389549ce8079ff46fd514467: Destroying tablet copy session bf69c081fbc04bb398d116939cc78f21-34b22fc778c04f25b5b0fe1635280e0c due to service shutdown
I20260929 11:36:35.062734 14199 tablet_copy_service.cc:433] P 79f6b689389549ce8079ff46fd514467: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-34b22fc778c04f25b5b0fe1635280e0c on tablet 34b22fc778c04f25b5b0fe1635280e0c with peer bf69c081fbc04bb398d116939cc78f21
I20260929 11:36:35.067102 17077 ts_tablet_manager.cc:1428] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
W20260929 11:36:35.067324 15310 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260929 11:36:35.069811 15310 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260929 11:36:35.094460 15310 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260929 11:36:35.094887 15310 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260929 11:36:35.102753 17078 tablet_copy_client.cc:316] T 70d952461bcb418b8e68f4389e815978 P bf69c081fbc04bb398d116939cc78f21: tablet copy: Beginning tablet copy session from remote peer at address 127.13.221.193:36849
I20260929 11:36:35.119866 17079 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260929 11:36:35.120074 16097 raft_consensus.cc:1203] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
W20260929 11:36:35.154165 15476 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 49639.2us
W20260929 11:36:35.153192 16060 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:36849, user_credentials={real_user=slave}} blocked reactor thread for 47296.3us
W20260929 11:36:35.161868 15402 consensus_peers.cc:487] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.162941 15402 consensus_peers.cc:487] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.160626 17079 tablet_bootstrap.cc:492] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: Bootstrap complete.
I20260929 11:36:35.164119 16094 raft_consensus.cc:1203] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260929 11:36:35.165112 17079 ts_tablet_manager.cc:1397] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: Time spent bootstrapping tablet: real 0.191s user 0.017s sys 0.011s
W20260929 11:36:35.169965 16060 consensus_peers.cc:487] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.171229 15476 consensus_peers.cc:487] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.168263 17079 raft_consensus.cc:348] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:35.173615 17079 raft_consensus.cc:729] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bf69c081fbc04bb398d116939cc78f21, State: Initialized, Role: LEARNER
I20260929 11:36:35.177932 17079 consensus_queue.cc:260] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } }
I20260929 11:36:35.187762 17079 ts_tablet_manager.cc:1428] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: Time spent starting tablet: real 0.022s user 0.009s sys 0.004s
I20260929 11:36:35.190522 15522 tablet_copy_service.cc:342] P adf4734bb02e4108b00fabc552483a18: Request end of tablet copy session bf69c081fbc04bb398d116939cc78f21-8119561598f743b799cb3b1843a3507f received from {username='slave'} at 127.0.0.1:55836
I20260929 11:36:35.190948 15522 tablet_copy_service.cc:433] P adf4734bb02e4108b00fabc552483a18: ending tablet copy session bf69c081fbc04bb398d116939cc78f21-8119561598f743b799cb3b1843a3507f on tablet 8119561598f743b799cb3b1843a3507f with peer bf69c081fbc04bb398d116939cc78f21
W20260929 11:36:35.198941 15476 consensus_peers.cc:487] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.205727 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:36:35.206634 14199 tablet_replica.cc:330] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.207475 14199 raft_consensus.cc:2229] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.208072 14199 raft_consensus.cc:2258] T ae0c7572ce72494f9c505c54480619fa P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.210796 14199 tablet_replica.cc:330] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.211825 14199 raft_consensus.cc:2229] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.212407 14199 raft_consensus.cc:2258] T b45a648c1e0b4665ae1e133d8f6fe219 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.214946 14199 tablet_replica.cc:330] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.215694 14199 raft_consensus.cc:2229] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.216179 14199 raft_consensus.cc:2258] T 375c6bdafb5c46df89bbbb95795b6812 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.218705 14199 tablet_replica.cc:330] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.219465 14199 raft_consensus.cc:2229] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.219974 14199 raft_consensus.cc:2258] T 6926107852c74f4aaf37989b571c292a P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.222391 14199 tablet_replica.cc:330] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.223181 14199 raft_consensus.cc:2229] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.224339 14199 raft_consensus.cc:2258] T bb49a87a20fe49448ce6bec0ace3573f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.226997 14199 tablet_replica.cc:330] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.227819 14199 raft_consensus.cc:2229] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.228782 14199 raft_consensus.cc:2258] T 0f77752fd0284cd5acb4a8de83942962 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.231678 14199 tablet_replica.cc:330] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.232635 14199 raft_consensus.cc:2229] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.233319 14199 raft_consensus.cc:2258] T 2454e1272e994181a08e49e54473af7a P 79f6b689389549ce8079ff46fd514467 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.235985 14199 tablet_replica.cc:330] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
W20260929 11:36:35.236179 16060 consensus_peers.cc:487] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.236999 14199 raft_consensus.cc:2229] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.237771 14199 raft_consensus.cc:2258] T 8119561598f743b799cb3b1843a3507f P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.240809 14199 tablet_replica.cc:330] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.241691 14199 raft_consensus.cc:2229] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.242177 14199 raft_consensus.cc:2258] T 9ab10cacb2684573bce3212170485cda P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.244833 14199 tablet_replica.cc:330] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.245718 14199 raft_consensus.cc:2229] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.247081 14199 raft_consensus.cc:2258] T 34b22fc778c04f25b5b0fe1635280e0c P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.249627 14199 tablet_replica.cc:330] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
W20260929 11:36:35.249754 16060 consensus_peers.cc:487] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.250437 14199 raft_consensus.cc:2229] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.251065 14199 raft_consensus.cc:2258] T d5a187e4fe114b97b83228cf0177ca13 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.253507 14199 tablet_replica.cc:330] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.254139 14199 raft_consensus.cc:2229] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.254587 14199 raft_consensus.cc:2258] T 293283a1ffae44dfb01a86f8eaf344f0 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.257122 14199 tablet_replica.cc:330] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.257645 14199 raft_consensus.cc:2229] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.258167 14199 raft_consensus.cc:2258] T 7eb6a5845e93469fb6516bd75d62c983 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.261651 14199 tablet_replica.cc:330] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.262627 14199 raft_consensus.cc:2229] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.263134 14199 raft_consensus.cc:2258] T 82d77475379646a99d34b739d3cfde14 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.265782 14199 tablet_replica.cc:330] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.266564 14199 raft_consensus.cc:2229] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.267357 14199 raft_consensus.cc:2258] T f281c33521294dbdac740fec2f2b0b51 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.269783 14199 tablet_replica.cc:330] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.270332 14199 raft_consensus.cc:2229] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.270803 14199 raft_consensus.cc:2258] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.273104 14199 tablet_replica.cc:330] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.273847 14199 raft_consensus.cc:2229] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.274354 14199 raft_consensus.cc:2258] T e9309f2844e444faaf2fbd9f0b77b132 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.276961 14199 tablet_replica.cc:330] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.277709 14199 raft_consensus.cc:2229] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.278690 14199 raft_consensus.cc:2258] T 3076393f65ab418199a711fc32bd3818 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.281311 14199 tablet_replica.cc:330] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.282039 14199 raft_consensus.cc:2229] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260929 11:36:35.282528 15476 consensus_peers.cc:487] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.282555 14199 raft_consensus.cc:2258] T 3fd843b2d55b4a9bb4755e0841e3c66e P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.283488 15476 consensus_peers.cc:487] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.283514 15402 consensus_peers.cc:487] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.285283 14199 tablet_replica.cc:330] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.286111 14199 raft_consensus.cc:2229] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260929 11:36:35.286288 15402 consensus_peers.cc:487] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.286715 14199 raft_consensus.cc:2258] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.288993 14199 tablet_replica.cc:330] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.289726 14199 raft_consensus.cc:2229] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
W20260929 11:36:35.289958 16060 consensus_peers.cc:487] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.290731 14199 raft_consensus.cc:2258] T 85688ae966734650b9fca8130f2feb8c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.293133 14199 tablet_replica.cc:330] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.293680 14199 raft_consensus.cc:2229] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.294641 14199 raft_consensus.cc:2258] T c7c9ca97877f48c9ba1c6a3503576624 P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.297235 14199 tablet_replica.cc:330] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.298022 14199 raft_consensus.cc:2229] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.298533 14199 raft_consensus.cc:2258] T b96455e9e76c407ab71b312b680a9c93 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.300911 14199 tablet_replica.cc:330] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
W20260929 11:36:35.301455 15476 consensus_peers.cc:487] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.301666 14199 raft_consensus.cc:2229] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.302711 14199 raft_consensus.cc:2258] T ab09a2671e654142a7a9d0078aff91ff P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.305356 14199 tablet_replica.cc:330] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.306006 14199 raft_consensus.cc:2229] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.306502 14199 raft_consensus.cc:2258] T 082d372bd5004d6e90543b4fe1ba1b88 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.308697 14199 tablet_replica.cc:330] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.309346 14199 raft_consensus.cc:2229] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.310320 14199 raft_consensus.cc:2258] T 809d1abd25d74defa0a2869d15a553b7 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.313678 14199 tablet_replica.cc:330] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.314411 14199 raft_consensus.cc:2229] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.314895 14199 raft_consensus.cc:2258] T 1839f2d147ac4c7a91bafb727fb103cd P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.317155 14199 tablet_replica.cc:330] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.317731 14199 raft_consensus.cc:2229] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.318166 14199 raft_consensus.cc:2258] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 79f6b689389549ce8079ff46fd514467 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.320631 14199 tablet_replica.cc:330] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.321316 14199 raft_consensus.cc:2229] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.322219 14199 raft_consensus.cc:2258] T e9bdacdc58094518aa9198105dee0e0b P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.324761 14199 tablet_replica.cc:330] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.325407 14199 raft_consensus.cc:2229] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.326299 14199 raft_consensus.cc:2258] T 20bfb5db2aab4679856838ec11feffc9 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.328562 14199 tablet_replica.cc:330] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.329152 14199 raft_consensus.cc:2229] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.330217 14199 raft_consensus.cc:2258] T 85b927b471cd474c88c32acd488f0492 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.332665 14199 tablet_replica.cc:330] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.333209 14199 raft_consensus.cc:2229] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.334085 14199 raft_consensus.cc:2258] T a423a044a6d34d8d86e6a2009617a53c P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.336561 14199 tablet_replica.cc:330] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.337248 14199 raft_consensus.cc:2229] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.337776 14199 raft_consensus.cc:2258] T 18064e092cec4a5fbc144b23fcd5abaf P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.340276 14199 tablet_replica.cc:330] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.341010 14199 raft_consensus.cc:2229] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.342069 14199 raft_consensus.cc:2258] T 5471502e24764effae2ab947ad5c8cb5 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.344796 14199 tablet_replica.cc:330] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.345515 14199 raft_consensus.cc:2229] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Raft consensus shutting down.
W20260929 11:36:35.346072 15476 consensus_peers.cc:487] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.346633 14199 raft_consensus.cc:2258] T e96d6ce3c2da47089d889e3b488fb3b8 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.349318 14199 tablet_replica.cc:330] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.349936 14199 raft_consensus.cc:2229] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.350347 14199 raft_consensus.cc:2258] T 40592b40c49441e1a1bb2e582199b023 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.361145 14199 tablet_replica.cc:330] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.361995 14199 raft_consensus.cc:2229] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.362648 14199 raft_consensus.cc:2258] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.365530 14199 tablet_replica.cc:330] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.366247 14199 raft_consensus.cc:2229] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.367239 14199 raft_consensus.cc:2258] T 4d4407712ee0451cb4fb2d8569e604cc P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.369742 14199 tablet_replica.cc:330] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.369915 16094 raft_consensus.cc:1203] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260929 11:36:35.370362 14199 raft_consensus.cc:2229] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.370954 14199 raft_consensus.cc:2258] T 087e3c24b1194324b1cbedc8cbbdf3cd P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.373494 14199 tablet_replica.cc:330] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.374156 14199 raft_consensus.cc:2229] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.375252 14199 raft_consensus.cc:2258] T 70d952461bcb418b8e68f4389e815978 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.378252 14199 tablet_replica.cc:330] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.378935 14199 raft_consensus.cc:2229] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.379475 14199 raft_consensus.cc:2258] T 133f7cd27af34f7ebc89e90b65170522 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.381902 14199 tablet_replica.cc:330] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.382611 14199 raft_consensus.cc:2229] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.383155 14199 raft_consensus.cc:2258] T 26f6df46badd473ab3b02a550aa18cc2 P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.383458 15476 consensus_peers.cc:487] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.386037 14199 tablet_replica.cc:330] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.386828 14199 raft_consensus.cc:2229] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.387396 14199 raft_consensus.cc:2258] T 06a45ce12d33457f8e8a937ebe912eff P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.389868 14199 tablet_replica.cc:330] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
W20260929 11:36:35.390267 16060 consensus_peers.cc:487] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.390537 14199 raft_consensus.cc:2229] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.391379 14199 raft_consensus.cc:2258] T 290cd2101f81472384670fdea31eaaf6 P 79f6b689389549ce8079ff46fd514467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.393939 14199 tablet_replica.cc:330] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.394472 14199 raft_consensus.cc:2229] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.394925 14199 raft_consensus.cc:2258] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 79f6b689389549ce8079ff46fd514467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.397368 14199 tablet_replica.cc:330] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467: stopping tablet replica
I20260929 11:36:35.397986 14199 raft_consensus.cc:2229] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 2 LEADER]: Raft consensus shutting down.
W20260929 11:36:35.398301 15476 consensus_peers.cc:487] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.398941 14199 raft_consensus.cc:2258] T 2f9ef265661b4a1b872b075ece5bb40d P 79f6b689389549ce8079ff46fd514467 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.404299 15402 consensus_peers.cc:487] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.418867 16060 consensus_peers.cc:487] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.422659 15402 consensus_peers.cc:487] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.426633 15402 consensus_peers.cc:487] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.433871 15402 consensus_peers.cc:487] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.441200 15476 consensus_peers.cc:487] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.450521 16060 consensus_peers.cc:487] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.453914 16060 consensus_peers.cc:487] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.457787 15402 consensus_peers.cc:487] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.515806 14199 tablet_server.cc:194] TabletServer@127.13.221.193:0 shutdown complete.
W20260929 11:36:35.530767 15402 consensus_peers.cc:487] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.531025 17059 raft_consensus.cc:1050] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:35.533989 17059 consensus_queue.cc:237] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:35.542551 16094 raft_consensus.cc:1261] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:35.544145 17060 consensus_queue.cc:1035] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:36:35.554996 15507 raft_consensus.cc:1261] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Refusing update from remote peer 2b2ed85c4da64515a0664b6c0421e078: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:35.556838 16993 consensus_queue.cc:1035] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260929 11:36:35.568980 15402 consensus_peers.cc:487] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.599764 16060 consensus_peers.cc:487] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.600530 17098 raft_consensus.cc:2932] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:35.602089 15509 raft_consensus.cc:2932] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
I20260929 11:36:35.613651 16094 raft_consensus.cc:2932] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
W20260929 11:36:35.615275 17077 tablet_copy_client.cc:1116] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111)
W20260929 11:36:35.622526 16060 consensus_peers.cc:487] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.623786 15402 consensus_peers.cc:487] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.631278 16060 connection.cc:441] server connection from 127.0.0.1:48220 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48220 (request call id 607) could send its response
I20260929 11:36:35.643010 15259 catalog_manager.cc:5495] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 reported cstate change: config changed from index 2 to 3, bf69c081fbc04bb398d116939cc78f21 (127.13.221.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2b2ed85c4da64515a0664b6c0421e078" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } }
W20260929 11:36:35.658059 16060 consensus_peers.cc:487] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.662205 14199 tablet_server.cc:178] TabletServer@127.13.221.194:0 shutting down...
W20260929 11:36:35.671964 16062 consensus_peers.cc:487] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.694199 15478 consensus_peers.cc:487] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.737695 15478 consensus_peers.cc:487] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:35.751430 15310 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260929 11:36:35.751823 15310 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260929 11:36:35.770416 15248 catalog_manager.cc:4584] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): ChangeConfig:REMOVE_PEER RPC failed for tablet d5a187e4fe114b97b83228cf0177ca13: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260929 11:36:35.789572 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:36:35.790620 14199 tablet_replica.cc:330] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.791540 14199 raft_consensus.cc:2229] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.792117 14199 raft_consensus.cc:2258] T 86dbbec4ace04094a09c85a3ad15d9fb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.794960 14199 tablet_replica.cc:330] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.795826 14199 raft_consensus.cc:2229] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.796361 14199 raft_consensus.cc:2258] T 375c6bdafb5c46df89bbbb95795b6812 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.798960 14199 tablet_replica.cc:330] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.799721 14199 raft_consensus.cc:2229] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.800735 14199 raft_consensus.cc:2258] T 29ac378824b145ee99c987e4c3413ee9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.802726 14199 tablet_replica.cc:330] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.803432 14199 raft_consensus.cc:2229] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.803939 14199 raft_consensus.cc:2258] T ae0c7572ce72494f9c505c54480619fa P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.806780 14199 tablet_replica.cc:330] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.811424 14199 raft_consensus.cc:2229] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.812047 14199 raft_consensus.cc:2258] T 8119561598f743b799cb3b1843a3507f P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.814630 14199 tablet_replica.cc:330] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
W20260929 11:36:35.818563 15478 consensus_peers.cc:487] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.815371 14199 raft_consensus.cc:2229] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.822302 14199 raft_consensus.cc:2258] T b45a648c1e0b4665ae1e133d8f6fe219 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.824918 14199 tablet_replica.cc:330] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.825743 14199 raft_consensus.cc:2229] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.826269 14199 raft_consensus.cc:2258] T 9ab10cacb2684573bce3212170485cda P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.829012 14199 tablet_replica.cc:330] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.829823 14199 raft_consensus.cc:2229] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.830344 14199 raft_consensus.cc:2258] T 7721312177b84c71ae4f6bea151091a8 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.832921 14199 tablet_replica.cc:330] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.833674 14199 raft_consensus.cc:2229] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.834589 14199 raft_consensus.cc:2258] T bbd4efefe8d54575b3b5575a504bb0a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.838465 14199 tablet_replica.cc:330] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.839278 14199 raft_consensus.cc:2229] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.839775 14199 raft_consensus.cc:2258] T 0f77752fd0284cd5acb4a8de83942962 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.842216 14199 tablet_replica.cc:330] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.842783 14199 raft_consensus.cc:2229] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.843261 14199 raft_consensus.cc:2258] T 2454e1272e994181a08e49e54473af7a P 2b2ed85c4da64515a0664b6c0421e078 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.845523 14199 tablet_replica.cc:330] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.846325 14199 raft_consensus.cc:2229] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.846984 14199 raft_consensus.cc:2258] T e37a9bc249c74356a37d92fe9124c7cc P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.849429 14199 tablet_replica.cc:330] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.850090 14199 raft_consensus.cc:2229] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.850692 14199 raft_consensus.cc:2258] T 34b22fc778c04f25b5b0fe1635280e0c P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.852761 14199 tablet_replica.cc:330] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.853279 14199 raft_consensus.cc:2229] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.854212 14199 raft_consensus.cc:2258] T d5a187e4fe114b97b83228cf0177ca13 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.858103 14199 tablet_replica.cc:330] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.858741 14199 raft_consensus.cc:2229] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Raft consensus shutting down.
W20260929 11:36:35.858929 16062 consensus_peers.cc:487] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.859656 14199 raft_consensus.cc:2258] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.862131 14199 tablet_replica.cc:330] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.862730 14199 raft_consensus.cc:2229] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.863624 14199 raft_consensus.cc:2258] T e4f3d509852942e2b45c13e1f5c5ea8d P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.866024 14199 tablet_replica.cc:330] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.866576 14199 raft_consensus.cc:2229] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.867245 14199 raft_consensus.cc:2258] T 7272ea4499be458a8d957a25b7d508bb P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.868304 16062 consensus_peers.cc:487] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.869616 14199 tablet_replica.cc:330] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.870410 14199 raft_consensus.cc:2229] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.870941 14199 raft_consensus.cc:2258] T 3fd843b2d55b4a9bb4755e0841e3c66e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.873294 14199 tablet_replica.cc:330] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.874112 14199 raft_consensus.cc:2229] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.875017 14199 raft_consensus.cc:2258] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.876830 14199 tablet_replica.cc:330] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.877332 14199 raft_consensus.cc:2229] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.878031 14199 raft_consensus.cc:2258] T 2b4452619bf4405caf985d1675be1408 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.880105 14199 tablet_replica.cc:330] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.880865 14199 raft_consensus.cc:2229] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.881846 14199 raft_consensus.cc:2258] T 293283a1ffae44dfb01a86f8eaf344f0 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.883579 16062 consensus_peers.cc:487] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.884109 14199 tablet_replica.cc:330] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.884898 14199 raft_consensus.cc:2229] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.885857 14199 raft_consensus.cc:2258] T 18064e092cec4a5fbc144b23fcd5abaf P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.888464 14199 tablet_replica.cc:330] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.889182 14199 raft_consensus.cc:2229] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.889724 14199 raft_consensus.cc:2258] T 5471502e24764effae2ab947ad5c8cb5 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.893107 14199 tablet_replica.cc:330] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.893901 14199 raft_consensus.cc:2229] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.894343 14199 raft_consensus.cc:2258] T 809d1abd25d74defa0a2869d15a553b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.896116 15478 consensus_peers.cc:487] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.896590 14199 tablet_replica.cc:330] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.897378 14199 raft_consensus.cc:2229] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.898047 14199 raft_consensus.cc:2258] T 85688ae966734650b9fca8130f2feb8c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.898406 15478 consensus_peers.cc:487] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.900374 14199 tablet_replica.cc:330] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.901149 14199 raft_consensus.cc:2229] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.901688 14199 raft_consensus.cc:2258] T 69f25939e19c461ab830dd08f6e6b790 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.903672 14199 tablet_replica.cc:330] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.904294 14199 raft_consensus.cc:2229] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.904742 14199 raft_consensus.cc:2258] T ab09a2671e654142a7a9d0078aff91ff P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.907174 14199 tablet_replica.cc:330] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.907938 14199 raft_consensus.cc:2229] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.908890 14199 raft_consensus.cc:2258] T b96455e9e76c407ab71b312b680a9c93 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.911306 14199 tablet_replica.cc:330] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.912004 14199 raft_consensus.cc:2229] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.912495 14199 raft_consensus.cc:2258] T 5af50e35934e4cd3960c886105fb34b7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.915216 14199 tablet_replica.cc:330] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.915966 14199 raft_consensus.cc:2229] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.916666 14199 raft_consensus.cc:2258] T 26f6df46badd473ab3b02a550aa18cc2 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.919299 14199 tablet_replica.cc:330] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.919976 14199 raft_consensus.cc:2229] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.921005 14199 raft_consensus.cc:2258] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.923301 14199 tablet_replica.cc:330] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
W20260929 11:36:35.923583 15478 consensus_peers.cc:487] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.924116 14199 raft_consensus.cc:2229] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.924798 14199 raft_consensus.cc:2258] T 4d4407712ee0451cb4fb2d8569e604cc P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.926810 14199 tablet_replica.cc:330] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.927356 14199 raft_consensus.cc:2229] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.927731 14199 raft_consensus.cc:2258] T 087e3c24b1194324b1cbedc8cbbdf3cd P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.929878 14199 tablet_replica.cc:330] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.930541 14199 raft_consensus.cc:2229] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.931034 14199 raft_consensus.cc:2258] T 70d952461bcb418b8e68f4389e815978 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.933377 14199 tablet_replica.cc:330] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.934046 14199 raft_consensus.cc:2229] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.934557 14199 raft_consensus.cc:2258] T 8351697a268a4337843da29ee5afac70 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.936874 14199 tablet_replica.cc:330] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.937542 14199 raft_consensus.cc:2229] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.938098 14199 raft_consensus.cc:2258] T f969b15260af489b992eeca4080e55ed P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.940676 14199 tablet_replica.cc:330] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.941318 14199 raft_consensus.cc:2229] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.942247 14199 raft_consensus.cc:2258] T 82d77475379646a99d34b739d3cfde14 P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.944661 14199 tablet_replica.cc:330] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.945242 14199 raft_consensus.cc:2229] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.946085 14199 raft_consensus.cc:2258] T 282bceebd7ed425db943d6b72f2513a1 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.946702 15478 consensus_peers.cc:487] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.948043 14199 tablet_replica.cc:330] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.948709 14199 raft_consensus.cc:2229] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.949208 14199 raft_consensus.cc:2258] T a423a044a6d34d8d86e6a2009617a53c P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.951359 14199 tablet_replica.cc:330] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.951946 14199 raft_consensus.cc:2229] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 4 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.952713 14199 raft_consensus.cc:2258] T 0c811ec08bf7499f8b0fa3f8b34fb290 P 2b2ed85c4da64515a0664b6c0421e078 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.954717 14199 tablet_replica.cc:330] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.955192 14199 raft_consensus.cc:2229] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.955631 14199 raft_consensus.cc:2258] T 1839f2d147ac4c7a91bafb727fb103cd P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.957767 14199 tablet_replica.cc:330] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.958392 14199 raft_consensus.cc:2229] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.958945 14199 raft_consensus.cc:2258] T 06a45ce12d33457f8e8a937ebe912eff P 2b2ed85c4da64515a0664b6c0421e078 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.961249 14199 tablet_replica.cc:330] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.961726 14199 raft_consensus.cc:2229] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:35.962483 14199 raft_consensus.cc:2258] T 40592b40c49441e1a1bb2e582199b023 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.964517 14199 tablet_replica.cc:330] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.965009 14199 raft_consensus.cc:2229] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.965426 14199 raft_consensus.cc:2258] T c7c9ca97877f48c9ba1c6a3503576624 P 2b2ed85c4da64515a0664b6c0421e078 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.967397 14199 tablet_replica.cc:330] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.967927 14199 raft_consensus.cc:2229] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.968683 14199 raft_consensus.cc:2258] T 20bfb5db2aab4679856838ec11feffc9 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:35.970749 14199 tablet_replica.cc:330] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078: stopping tablet replica
I20260929 11:36:35.971235 14199 raft_consensus.cc:2229] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:35.971786 14199 raft_consensus.cc:2258] T 85b927b471cd474c88c32acd488f0492 P 2b2ed85c4da64515a0664b6c0421e078 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:35.982736 16062 consensus_peers.cc:487] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:35.984678 17075 raft_consensus.cc:1050] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: attempting to promote NON_VOTER bf69c081fbc04bb398d116939cc78f21 to VOTER
I20260929 11:36:35.987527 17075 consensus_queue.cc:237] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:35.993911 16094 raft_consensus.cc:1261] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Refusing update from remote peer adf4734bb02e4108b00fabc552483a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260929 11:36:35.995576 17043 consensus_queue.cc:1035] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260929 11:36:36.002038 15478 consensus_peers.cc:487] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.004135 15476 consensus_peers.cc:487] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 -> Peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Couldn't send request to peer 79f6b689389549ce8079ff46fd514467. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.013002 15478 consensus_peers.cc:487] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.028446 16062 consensus_peers.cc:487] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.039052 15478 consensus_peers.cc:487] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.094419 15478 consensus_peers.cc:487] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.102962 16062 consensus_peers.cc:487] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.107934 14199 tablet_server.cc:194] TabletServer@127.13.221.194:0 shutdown complete.
W20260929 11:36:36.115227 15478 consensus_peers.cc:487] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.132041 16062 consensus_peers.cc:487] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.140251 16062 consensus_peers.cc:487] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 -> Peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Couldn't send request to peer 2b2ed85c4da64515a0664b6c0421e078. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.225522 14199 tablet_server.cc:178] TabletServer@127.13.221.195:0 shutting down...
W20260929 11:36:36.231127 15310 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260929 11:36:36.231371 15310 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260929 11:36:36.270257 16062 consensus_peers.cc:487] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260929 11:36:36.270994 16062 consensus_peers.cc:487] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.287914 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
W20260929 11:36:36.288309 16062 consensus_peers.cc:487] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.288882 14199 tablet_replica.cc:330] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.289598 14199 raft_consensus.cc:2229] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.290138 14199 raft_consensus.cc:2258] T 86dbbec4ace04094a09c85a3ad15d9fb P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.292040 14199 tablet_replica.cc:330] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.292689 14199 raft_consensus.cc:2229] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.293431 14199 raft_consensus.cc:2258] T 375c6bdafb5c46df89bbbb95795b6812 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.295132 14199 tablet_replica.cc:330] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.295665 14199 raft_consensus.cc:2229] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.296175 14199 raft_consensus.cc:2258] T 29ac378824b145ee99c987e4c3413ee9 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.297875 14199 tablet_replica.cc:330] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.298380 14199 raft_consensus.cc:2229] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.298765 14199 raft_consensus.cc:2258] T b45a648c1e0b4665ae1e133d8f6fe219 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.300546 14199 tablet_replica.cc:330] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.301098 14199 raft_consensus.cc:2229] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.301563 14199 raft_consensus.cc:2258] T bb49a87a20fe49448ce6bec0ace3573f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.303675 14199 tablet_replica.cc:330] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.304404 14199 raft_consensus.cc:2229] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260929 11:36:36.305011 16062 consensus_peers.cc:487] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.305104 14199 raft_consensus.cc:2258] T 6926107852c74f4aaf37989b571c292a P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.306977 14199 tablet_replica.cc:330] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.307499 14199 raft_consensus.cc:2229] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.311437 14199 pending_rounds.cc:62] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: Trying to abort 1 pending ops.
I20260929 11:36:36.311625 14199 pending_rounds.cc:68] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7334632636357386240 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "8119561598f743b799cb3b1843a3507f" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } } }
I20260929 11:36:36.312422 14199 raft_consensus.cc:2894] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260929 11:36:36.312695 14199 raft_consensus.cc:2866] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260929 11:36:36.312883 14199 raft_consensus.cc:2258] T 8119561598f743b799cb3b1843a3507f P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.315462 14199 tablet_replica.cc:330] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.316015 14199 raft_consensus.cc:2229] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.316592 14199 raft_consensus.cc:2258] T d5a187e4fe114b97b83228cf0177ca13 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:36.318111 16062 consensus_peers.cc:487] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.319164 14199 tablet_replica.cc:330] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.319784 14199 raft_consensus.cc:2229] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.320611 14199 raft_consensus.cc:2258] T e37a9bc249c74356a37d92fe9124c7cc P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.322230 14199 tablet_replica.cc:330] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.322743 14199 raft_consensus.cc:2229] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.323203 14199 raft_consensus.cc:2258] T 34b22fc778c04f25b5b0fe1635280e0c P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.325085 14199 tablet_replica.cc:330] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.325763 14199 raft_consensus.cc:2229] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.326277 14199 raft_consensus.cc:2258] T e4f3d509852942e2b45c13e1f5c5ea8d P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.327865 14199 tablet_replica.cc:330] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.328467 14199 raft_consensus.cc:2229] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.329134 14199 raft_consensus.cc:2258] T 9ab10cacb2684573bce3212170485cda P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.330796 14199 tablet_replica.cc:330] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.331331 14199 raft_consensus.cc:2229] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.332049 14199 raft_consensus.cc:2258] T 7272ea4499be458a8d957a25b7d508bb P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.333611 14199 tablet_replica.cc:330] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.334144 14199 raft_consensus.cc:2229] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.334558 14199 raft_consensus.cc:2258] T bbd4efefe8d54575b3b5575a504bb0a1 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.336265 14199 tablet_replica.cc:330] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.336863 14199 raft_consensus.cc:2229] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.337615 14199 raft_consensus.cc:2258] T 7721312177b84c71ae4f6bea151091a8 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.339398 14199 tablet_replica.cc:330] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.339960 14199 raft_consensus.cc:2229] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.340543 14199 raft_consensus.cc:2258] T 7eb6a5845e93469fb6516bd75d62c983 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.342540 14199 tablet_replica.cc:330] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.343408 14199 raft_consensus.cc:2229] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.344164 14199 raft_consensus.cc:2258] T f281c33521294dbdac740fec2f2b0b51 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.345902 14199 tablet_replica.cc:330] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.346473 14199 raft_consensus.cc:2229] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.346875 14199 raft_consensus.cc:2258] T 0cf31b2803e34f7a9c2d7bdea21cc0bd P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.348558 14199 tablet_replica.cc:330] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.349072 14199 raft_consensus.cc:2229] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.349628 14199 raft_consensus.cc:2258] T e9309f2844e444faaf2fbd9f0b77b132 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.351181 14199 tablet_replica.cc:330] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.351666 14199 raft_consensus.cc:2229] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.352068 14199 raft_consensus.cc:2258] T 69f25939e19c461ab830dd08f6e6b790 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.354087 14199 tablet_replica.cc:330] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.354651 14199 raft_consensus.cc:2229] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.355104 14199 raft_consensus.cc:2258] T 5af50e35934e4cd3960c886105fb34b7 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.357133 14199 tablet_replica.cc:330] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.357406 16961 raft_consensus.cc:482] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 79f6b689389549ce8079ff46fd514467)
I20260929 11:36:36.357815 14199 raft_consensus.cc:2229] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.357834 16961 raft_consensus.cc:504] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:36.358330 14199 raft_consensus.cc:2258] T b96455e9e76c407ab71b312b680a9c93 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.359508 16961 leader_election.cc:288] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:36.360630 14199 tablet_replica.cc:330] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.361297 14199 raft_consensus.cc:2229] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.362106 14199 raft_consensus.cc:2258] T 3fd843b2d55b4a9bb4755e0841e3c66e P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:36.363487 16060 leader_election.cc:334] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111)
W20260929 11:36:36.364113 16062 leader_election.cc:334] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111)
I20260929 11:36:36.364373 14199 tablet_replica.cc:330] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.364564 16062 leader_election.cc:302] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf69c081fbc04bb398d116939cc78f21; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:36:36.365208 14199 raft_consensus.cc:2229] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.365262 16961 raft_consensus.cc:2726] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:36:36.365911 14199 raft_consensus.cc:2258] T 3076393f65ab418199a711fc32bd3818 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.367666 14199 tablet_replica.cc:330] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.368192 14199 raft_consensus.cc:2229] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.368633 14199 raft_consensus.cc:2258] T ab09a2671e654142a7a9d0078aff91ff P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.370332 14199 tablet_replica.cc:330] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.370836 14199 raft_consensus.cc:2229] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.371205 14199 raft_consensus.cc:2258] T 082d372bd5004d6e90543b4fe1ba1b88 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.372807 14199 tablet_replica.cc:330] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.373315 14199 raft_consensus.cc:2229] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.373983 14199 raft_consensus.cc:2258] T e9bdacdc58094518aa9198105dee0e0b P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.375602 14199 tablet_replica.cc:330] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.376096 14199 raft_consensus.cc:2229] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.376519 14199 raft_consensus.cc:2258] T 0c811ec08bf7499f8b0fa3f8b34fb290 P adf4734bb02e4108b00fabc552483a18 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.378075 14199 tablet_replica.cc:330] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.378567 14199 raft_consensus.cc:2229] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.379269 14199 raft_consensus.cc:2258] T 290cd2101f81472384670fdea31eaaf6 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.380954 14199 tablet_replica.cc:330] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.381474 14199 raft_consensus.cc:2229] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.382230 14199 raft_consensus.cc:2258] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.383793 14199 tablet_replica.cc:330] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.384415 14199 raft_consensus.cc:2229] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.384846 14199 raft_consensus.cc:2258] T 82d77475379646a99d34b739d3cfde14 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.386912 14199 tablet_replica.cc:330] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.387637 14199 raft_consensus.cc:2229] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.388433 14199 raft_consensus.cc:2258] T 282bceebd7ed425db943d6b72f2513a1 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.390733 14199 tablet_replica.cc:330] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.391382 14199 raft_consensus.cc:2229] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.391849 14199 raft_consensus.cc:2258] T 809d1abd25d74defa0a2869d15a553b7 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.394093 14199 tablet_replica.cc:330] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.394762 14199 raft_consensus.cc:2229] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.395278 14199 raft_consensus.cc:2258] T ed8e53cca3ac4865ba0e4c18b7c9ad6e P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.397251 14199 tablet_replica.cc:330] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.397697 14199 raft_consensus.cc:2229] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.398373 14199 raft_consensus.cc:2258] T 2b4452619bf4405caf985d1675be1408 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.399919 14199 tablet_replica.cc:330] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.400460 14199 raft_consensus.cc:2229] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.400821 14199 raft_consensus.cc:2258] T 2f9ef265661b4a1b872b075ece5bb40d P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.402357 14199 tablet_replica.cc:330] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.402778 14199 raft_consensus.cc:2229] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.403523 14199 raft_consensus.cc:2258] T 8351697a268a4337843da29ee5afac70 P adf4734bb02e4108b00fabc552483a18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.405277 14199 tablet_replica.cc:330] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.405778 14199 raft_consensus.cc:2229] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.406531 14199 raft_consensus.cc:2258] T f969b15260af489b992eeca4080e55ed P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.408210 14199 tablet_replica.cc:330] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.408737 14199 raft_consensus.cc:2229] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.409158 14199 raft_consensus.cc:2258] T 9bdd351cd28a49e5b8a1ed5513b22cf7 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.411265 14199 tablet_replica.cc:330] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.411810 14199 raft_consensus.cc:2229] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.412288 14199 raft_consensus.cc:2258] T 4d4407712ee0451cb4fb2d8569e604cc P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.414525 14199 tablet_replica.cc:330] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.415128 14199 raft_consensus.cc:2229] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.415319 16961 raft_consensus.cc:482] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79f6b689389549ce8079ff46fd514467)
I20260929 11:36:36.415668 14199 raft_consensus.cc:2258] T 70d952461bcb418b8e68f4389e815978 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.415807 16961 raft_consensus.cc:504] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:36.417681 16961 leader_election.cc:288] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:36.418259 14199 tablet_replica.cc:330] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.418931 14199 raft_consensus.cc:2229] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.419878 14199 raft_consensus.cc:2258] T 087e3c24b1194324b1cbedc8cbbdf3cd P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260929 11:36:36.421311 16060 leader_election.cc:334] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111)
W20260929 11:36:36.421774 16062 leader_election.cc:334] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260929 11:36:36.422201 16062 leader_election.cc:302] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf69c081fbc04bb398d116939cc78f21; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:36:36.422564 14199 tablet_replica.cc:330] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.422914 16961 raft_consensus.cc:2726] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:36.423285 14199 raft_consensus.cc:2229] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.423789 14199 raft_consensus.cc:2258] T 133f7cd27af34f7ebc89e90b65170522 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.425606 14199 tablet_replica.cc:330] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.426101 14199 raft_consensus.cc:2229] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.426436 14199 raft_consensus.cc:2258] T 40592b40c49441e1a1bb2e582199b023 P adf4734bb02e4108b00fabc552483a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.428608 14199 tablet_replica.cc:330] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18: stopping tablet replica
I20260929 11:36:36.429230 14199 raft_consensus.cc:2229] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.429702 14199 raft_consensus.cc:2258] T e96d6ce3c2da47089d889e3b488fb3b8 P adf4734bb02e4108b00fabc552483a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.440894 16961 raft_consensus.cc:482] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79f6b689389549ce8079ff46fd514467)
I20260929 11:36:36.441298 16961 raft_consensus.cc:504] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:36.442890 16961 leader_election.cc:288] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
W20260929 11:36:36.445519 16062 leader_election.cc:334] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260929 11:36:36.446313 16060 leader_election.cc:334] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111)
I20260929 11:36:36.446650 16060 leader_election.cc:302] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf69c081fbc04bb398d116939cc78f21; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:36:36.447202 16961 raft_consensus.cc:2726] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260929 11:36:36.474110 16062 consensus_peers.cc:487] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.476536 16961 raft_consensus.cc:482] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79f6b689389549ce8079ff46fd514467)
I20260929 11:36:36.476792 17091 raft_consensus.cc:482] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79f6b689389549ce8079ff46fd514467)
I20260929 11:36:36.477144 16961 raft_consensus.cc:504] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:36.477233 17091 raft_consensus.cc:504] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:36.479035 17091 leader_election.cc:288] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
I20260929 11:36:36.479035 16961 leader_election.cc:288] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
I20260929 11:36:36.484815 16961 raft_consensus.cc:482] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79f6b689389549ce8079ff46fd514467)
I20260929 11:36:36.485410 16961 raft_consensus.cc:504] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
W20260929 11:36:36.486687 16060 leader_election.cc:334] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111)
W20260929 11:36:36.488015 16060 leader_election.cc:334] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111)
I20260929 11:36:36.488502 16961 leader_election.cc:288] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925)
W20260929 11:36:36.488411 16062 leader_election.cc:334] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111)
I20260929 11:36:36.490957 16062 leader_election.cc:302] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf69c081fbc04bb398d116939cc78f21; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
W20260929 11:36:36.492370 16062 leader_election.cc:334] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260929 11:36:36.492704 16961 raft_consensus.cc:2726] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:36.492748 16062 leader_election.cc:302] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf69c081fbc04bb398d116939cc78f21; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:36:36.494756 16961 raft_consensus.cc:2726] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260929 11:36:36.494279 16060 leader_election.cc:334] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111)
W20260929 11:36:36.497570 16062 leader_election.cc:334] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111)
I20260929 11:36:36.497965 16062 leader_election.cc:302] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf69c081fbc04bb398d116939cc78f21; no voters: 2b2ed85c4da64515a0664b6c0421e078, 79f6b689389549ce8079ff46fd514467
I20260929 11:36:36.498535 16961 raft_consensus.cc:2726] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:36.539978 14199 tablet_server.cc:194] TabletServer@127.13.221.195:0 shutdown complete.
I20260929 11:36:36.593078 16961 raft_consensus.cc:482] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79f6b689389549ce8079ff46fd514467)
I20260929 11:36:36.594304 16961 raft_consensus.cc:504] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } }
I20260929 11:36:36.596565 16961 leader_election.cc:288] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849), adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107)
W20260929 11:36:36.600404 16060 leader_election.cc:334] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 79f6b689389549ce8079ff46fd514467 (127.13.221.193:36849): Network error: Client connection negotiation failed: client connection to 127.13.221.193:36849: connect: Connection refused (error 111)
W20260929 11:36:36.601781 16062 leader_election.cc:334] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Network error: Client connection negotiation failed: client connection to 127.13.221.195:37107: connect: Connection refused (error 111)
I20260929 11:36:36.602205 16062 leader_election.cc:302] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf69c081fbc04bb398d116939cc78f21; no voters: 79f6b689389549ce8079ff46fd514467, adf4734bb02e4108b00fabc552483a18
I20260929 11:36:36.602934 16961 raft_consensus.cc:2726] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:36:36.615836 16062 consensus_peers.cc:487] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.195:37107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.618255 14199 tablet_server.cc:178] TabletServer@127.13.221.196:0 shutting down...
W20260929 11:36:36.631103 16062 consensus_peers.cc:487] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 -> Peer adf4734bb02e4108b00fabc552483a18 (127.13.221.195:37107): Couldn't send request to peer adf4734bb02e4108b00fabc552483a18. Status: Network error: Client connection negotiation failed: client connection to 127.13.221.195:37107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:36.652238 14199 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260929 11:36:36.653133 14199 tablet_replica.cc:330] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.653748 14199 raft_consensus.cc:2229] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.654145 14199 pending_rounds.cc:62] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: Trying to abort 1 pending ops.
I20260929 11:36:36.654353 14199 pending_rounds.cc:68] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7334632636357386240 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "8119561598f743b799cb3b1843a3507f" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: NON_VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "79f6b689389549ce8079ff46fd514467" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 36849 } attrs { replace: true } } peers { permanent_uuid: "2b2ed85c4da64515a0664b6c0421e078" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 33925 } } peers { permanent_uuid: "adf4734bb02e4108b00fabc552483a18" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 37107 } } peers { permanent_uuid: "bf69c081fbc04bb398d116939cc78f21" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39689 } attrs { promote: false } } } }
I20260929 11:36:36.655095 14199 raft_consensus.cc:2894] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260929 11:36:36.655409 14199 raft_consensus.cc:2866] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260929 11:36:36.655673 14199 raft_consensus.cc:2258] T 8119561598f743b799cb3b1843a3507f P bf69c081fbc04bb398d116939cc78f21 [term 1 LEARNER]: Raft consensus is shut down!
I20260929 11:36:36.658107 14199 tablet_replica.cc:330] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.658726 14199 raft_consensus.cc:2229] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Raft consensus shutting down.
I20260929 11:36:36.659118 14199 raft_consensus.cc:2258] T 34b22fc778c04f25b5b0fe1635280e0c P bf69c081fbc04bb398d116939cc78f21 [term 2 LEARNER]: Raft consensus is shut down!
I20260929 11:36:36.660799 14199 tablet_replica.cc:330] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.661341 14199 raft_consensus.cc:2229] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.661963 14199 raft_consensus.cc:2258] T 3076393f65ab418199a711fc32bd3818 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.664278 14199 tablet_replica.cc:330] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.665160 14199 raft_consensus.cc:2229] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.665787 14199 raft_consensus.cc:2258] T bbd4efefe8d54575b3b5575a504bb0a1 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.667533 14199 tablet_replica.cc:330] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.668067 14199 raft_consensus.cc:2229] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 3 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.668823 14199 raft_consensus.cc:2258] T 0f77752fd0284cd5acb4a8de83942962 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.670573 14199 tablet_replica.cc:330] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.671114 14199 raft_consensus.cc:2229] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.671548 14199 raft_consensus.cc:2258] T 4188ffe2fdb34c9f9b5349a5aeff90a3 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.673288 14199 tablet_replica.cc:330] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.673839 14199 raft_consensus.cc:2229] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.674271 14199 raft_consensus.cc:2258] T bb49a87a20fe49448ce6bec0ace3573f P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.676043 14199 tablet_replica.cc:330] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.676648 14199 raft_consensus.cc:2229] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.677135 14199 raft_consensus.cc:2258] T 29ac378824b145ee99c987e4c3413ee9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.678733 14199 tablet_replica.cc:330] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.679282 14199 raft_consensus.cc:2229] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.679714 14199 raft_consensus.cc:2258] T d5a187e4fe114b97b83228cf0177ca13 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.681303 14199 tablet_replica.cc:330] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.681859 14199 raft_consensus.cc:2229] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.682715 14199 raft_consensus.cc:2258] T 8351697a268a4337843da29ee5afac70 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.684538 14199 tablet_replica.cc:330] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.685086 14199 raft_consensus.cc:2229] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.685526 14199 raft_consensus.cc:2258] T 20bfb5db2aab4679856838ec11feffc9 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.687120 14199 tablet_replica.cc:330] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.687640 14199 raft_consensus.cc:2229] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.688360 14199 raft_consensus.cc:2258] T 6926107852c74f4aaf37989b571c292a P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.690845 14199 tablet_replica.cc:330] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.691366 14199 raft_consensus.cc:2229] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 5 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.692076 14199 raft_consensus.cc:2258] T 2454e1272e994181a08e49e54473af7a P bf69c081fbc04bb398d116939cc78f21 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.693691 14199 tablet_replica.cc:330] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.694269 14199 raft_consensus.cc:2229] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.694777 14199 raft_consensus.cc:2258] T 5471502e24764effae2ab947ad5c8cb5 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.696480 14199 tablet_replica.cc:330] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.697034 14199 raft_consensus.cc:2229] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.697495 14199 raft_consensus.cc:2258] T 18064e092cec4a5fbc144b23fcd5abaf P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.699150 14199 tablet_replica.cc:330] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.699819 14199 raft_consensus.cc:2229] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.700253 14199 raft_consensus.cc:2258] T 290cd2101f81472384670fdea31eaaf6 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.701737 14199 tablet_replica.cc:330] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.702169 14199 raft_consensus.cc:2229] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.702798 14199 raft_consensus.cc:2258] T 26f6df46badd473ab3b02a550aa18cc2 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.704660 14199 tablet_replica.cc:330] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.705178 14199 raft_consensus.cc:2229] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.705736 14199 raft_consensus.cc:2258] T f281c33521294dbdac740fec2f2b0b51 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.707619 14199 tablet_replica.cc:330] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.708148 14199 raft_consensus.cc:2229] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.708855 14199 raft_consensus.cc:2258] T e9309f2844e444faaf2fbd9f0b77b132 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.710506 14199 tablet_replica.cc:330] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.710949 14199 raft_consensus.cc:2229] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.711400 14199 raft_consensus.cc:2258] T c7c9ca97877f48c9ba1c6a3503576624 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.712973 14199 tablet_replica.cc:330] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.713434 14199 raft_consensus.cc:2229] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.713829 14199 raft_consensus.cc:2258] T 85688ae966734650b9fca8130f2feb8c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.715535 14199 tablet_replica.cc:330] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.715987 14199 raft_consensus.cc:2229] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.716482 14199 raft_consensus.cc:2258] T a423a044a6d34d8d86e6a2009617a53c P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.718005 14199 tablet_replica.cc:330] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.718456 14199 raft_consensus.cc:2229] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.718869 14199 raft_consensus.cc:2258] T 282bceebd7ed425db943d6b72f2513a1 P bf69c081fbc04bb398d116939cc78f21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.720598 14199 tablet_replica.cc:330] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.721052 14199 raft_consensus.cc:2229] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.721719 14199 raft_consensus.cc:2258] T ae0c7572ce72494f9c505c54480619fa P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.723238 14199 tablet_replica.cc:330] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.723831 14199 raft_consensus.cc:2229] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.724283 14199 raft_consensus.cc:2258] T 2b4452619bf4405caf985d1675be1408 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.727011 14199 tablet_replica.cc:330] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.728063 14199 raft_consensus.cc:2229] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.728847 14199 raft_consensus.cc:2258] T 2f9ef265661b4a1b872b075ece5bb40d P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.730492 14199 tablet_replica.cc:330] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.730998 14199 raft_consensus.cc:2229] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.731488 14199 raft_consensus.cc:2258] T f969b15260af489b992eeca4080e55ed P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.733139 14199 tablet_replica.cc:330] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.733661 14199 raft_consensus.cc:2229] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.734393 14199 raft_consensus.cc:2258] T 7eb6a5845e93469fb6516bd75d62c983 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.735993 14199 tablet_replica.cc:330] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.736539 14199 raft_consensus.cc:2229] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.736974 14199 raft_consensus.cc:2258] T 293283a1ffae44dfb01a86f8eaf344f0 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.738540 14199 tablet_replica.cc:330] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.739032 14199 raft_consensus.cc:2229] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.739473 14199 raft_consensus.cc:2258] T e9bdacdc58094518aa9198105dee0e0b P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.741094 14199 tablet_replica.cc:330] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.741577 14199 raft_consensus.cc:2229] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.742288 14199 raft_consensus.cc:2258] T 1839f2d147ac4c7a91bafb727fb103cd P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.743944 14199 tablet_replica.cc:330] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.744485 14199 raft_consensus.cc:2229] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.745151 14199 raft_consensus.cc:2258] T 5af50e35934e4cd3960c886105fb34b7 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.746788 14199 tablet_replica.cc:330] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.747270 14199 raft_consensus.cc:2229] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.747720 14199 raft_consensus.cc:2258] T 7272ea4499be458a8d957a25b7d508bb P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.749253 14199 tablet_replica.cc:330] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.749707 14199 raft_consensus.cc:2229] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.750187 14199 raft_consensus.cc:2258] T 7721312177b84c71ae4f6bea151091a8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.751814 14199 tablet_replica.cc:330] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.752233 14199 raft_consensus.cc:2229] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.752875 14199 raft_consensus.cc:2258] T 69f25939e19c461ab830dd08f6e6b790 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.754300 14199 tablet_replica.cc:330] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.754719 14199 raft_consensus.cc:2229] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.755321 14199 raft_consensus.cc:2258] T 082d372bd5004d6e90543b4fe1ba1b88 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.757000 14199 tablet_replica.cc:330] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.757444 14199 raft_consensus.cc:2229] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.757864 14199 raft_consensus.cc:2258] T e4f3d509852942e2b45c13e1f5c5ea8d P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.759419 14199 tablet_replica.cc:330] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.759938 14199 raft_consensus.cc:2229] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.760598 14199 raft_consensus.cc:2258] T 06a45ce12d33457f8e8a937ebe912eff P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.762202 14199 tablet_replica.cc:330] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.762630 14199 raft_consensus.cc:2229] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.762996 14199 raft_consensus.cc:2258] T e96d6ce3c2da47089d889e3b488fb3b8 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.764480 14199 tablet_replica.cc:330] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.764858 14199 raft_consensus.cc:2229] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.765523 14199 raft_consensus.cc:2258] T 133f7cd27af34f7ebc89e90b65170522 P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.766996 14199 tablet_replica.cc:330] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.767380 14199 raft_consensus.cc:2229] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 2 LEADER]: Raft consensus shutting down.
I20260929 11:36:36.768003 14199 raft_consensus.cc:2258] T 86dbbec4ace04094a09c85a3ad15d9fb P bf69c081fbc04bb398d116939cc78f21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.769507 14199 tablet_replica.cc:330] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.769876 14199 raft_consensus.cc:2229] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.770273 14199 raft_consensus.cc:2258] T e37a9bc249c74356a37d92fe9124c7cc P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.771806 14199 tablet_replica.cc:330] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21: stopping tablet replica
I20260929 11:36:36.772162 14199 raft_consensus.cc:2229] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260929 11:36:36.772651 14199 raft_consensus.cc:2258] T 85b927b471cd474c88c32acd488f0492 P bf69c081fbc04bb398d116939cc78f21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:36.830240 14199 tablet_server.cc:194] TabletServer@127.13.221.196:0 shutdown complete.
I20260929 11:36:36.882171 14199 master.cc:537] Master@127.13.221.254:38577 shutting down...
W20260929 11:36:37.027398 15248 catalog_manager.cc:4584] TS 2b2ed85c4da64515a0664b6c0421e078 (127.13.221.194:33925): ChangeConfig:REMOVE_PEER RPC failed for tablet d5a187e4fe114b97b83228cf0177ca13: Network error: Client connection negotiation failed: client connection to 127.13.221.194:33925: connect: Connection refused (error 111)
I20260929 11:36:37.039198 14199 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 1 LEADER]: Raft consensus shutting down.
I20260929 11:36:37.039904 14199 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260929 11:36:37.040256 14199 tablet_replica.cc:330] T 00000000000000000000000000000000 P 233261f838454e45a0a998f55dba0c89: stopping tablet replica
I20260929 11:36:37.064580 14199 master.cc:552] Master@127.13.221.254:38577 shutdown complete.
[ OK ] LeaderRebalancerTest.AddTserver (52629 ms)
[ RUN ] LeaderRebalancerTest.RestartTserver
I20260929 11:36:37.154873 14199 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.221.254:34761
I20260929 11:36:37.156044 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:36:37.162427 17116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:36:37.162557 17117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:36:37.163671 17119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:36:37.164196 14199 server_base.cc:1034] running on GCE node
I20260929 11:36:37.165621 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:36:37.165848 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:36:37.166049 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681797166031 us; error 0 us; skew 500 ppm
I20260929 11:36:37.166572 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:36:37.169467 14199 webserver.cc:460] Webserver started at http://127.13.221.254:36655/ using document root <none> and password file <none>
I20260929 11:36:37.169963 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:36:37.170163 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:36:37.170452 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:36:37.171600 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/master-0-root/instance:
uuid: "0819e8fa71684f4ca7e117f46b4507bf"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.176246 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260929 11:36:37.179615 17124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.180605 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260929 11:36:37.180855 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/master-0-root
uuid: "0819e8fa71684f4ca7e117f46b4507bf"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.181105 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:36:37.200814 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:36:37.201990 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:36:37.240557 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.254:34761
I20260929 11:36:37.240655 17175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.254:34761 every 8 connection(s)
I20260929 11:36:37.244293 17176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:37.253908 17176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf: Bootstrap starting.
I20260929 11:36:37.258213 17176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:37.262207 17176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf: No bootstrap required, opened a new log
I20260929 11:36:37.264129 17176 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0819e8fa71684f4ca7e117f46b4507bf" member_type: VOTER }
I20260929 11:36:37.264518 17176 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:37.264688 17176 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0819e8fa71684f4ca7e117f46b4507bf, State: Initialized, Role: FOLLOWER
I20260929 11:36:37.265159 17176 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0819e8fa71684f4ca7e117f46b4507bf" member_type: VOTER }
I20260929 11:36:37.265554 17176 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260929 11:36:37.265731 17176 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260929 11:36:37.265924 17176 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:37.270157 17176 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0819e8fa71684f4ca7e117f46b4507bf" member_type: VOTER }
I20260929 11:36:37.270697 17176 leader_election.cc:302] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0819e8fa71684f4ca7e117f46b4507bf; no voters:
I20260929 11:36:37.271788 17176 leader_election.cc:288] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260929 11:36:37.272205 17179 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:37.273627 17179 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [term 1 LEADER]: Becoming Leader. State: Replica: 0819e8fa71684f4ca7e117f46b4507bf, State: Running, Role: LEADER
I20260929 11:36:37.274266 17179 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0819e8fa71684f4ca7e117f46b4507bf" member_type: VOTER }
I20260929 11:36:37.274598 17176 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [sys.catalog]: configured and running, proceeding with master startup.
I20260929 11:36:37.278605 17180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0819e8fa71684f4ca7e117f46b4507bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0819e8fa71684f4ca7e117f46b4507bf" member_type: VOTER } }
I20260929 11:36:37.279268 17180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [sys.catalog]: This master's current role is: LEADER
I20260929 11:36:37.279382 17181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0819e8fa71684f4ca7e117f46b4507bf. Latest consensus state: current_term: 1 leader_uuid: "0819e8fa71684f4ca7e117f46b4507bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0819e8fa71684f4ca7e117f46b4507bf" member_type: VOTER } }
I20260929 11:36:37.279978 17181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf [sys.catalog]: This master's current role is: LEADER
I20260929 11:36:37.282285 17186 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260929 11:36:37.288862 17186 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260929 11:36:37.289873 14199 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260929 11:36:37.297338 17186 catalog_manager.cc:1347] Generated new cluster ID: a0f5a7cd325f44639631bbe8c35c7797
I20260929 11:36:37.297732 17186 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260929 11:36:37.338122 17186 catalog_manager.cc:1370] Generated new certificate authority record
I20260929 11:36:37.339727 17186 catalog_manager.cc:1504] Loading token signing keys...
I20260929 11:36:37.359656 17186 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf: Generated new TSK 0
I20260929 11:36:37.360373 17186 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260929 11:36:37.420948 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:36:37.426756 17197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:36:37.428280 17198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:36:37.430325 14199 server_base.cc:1034] running on GCE node
W20260929 11:36:37.430275 17200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:36:37.437179 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:36:37.437415 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:36:37.437536 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681797437527 us; error 0 us; skew 500 ppm
I20260929 11:36:37.437988 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:36:37.440570 14199 webserver.cc:460] Webserver started at http://127.13.221.193:44695/ using document root <none> and password file <none>
I20260929 11:36:37.441016 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:36:37.441165 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:36:37.441372 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:36:37.442420 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/instance:
uuid: "013a37bea2eb40c0ad4ce8f296176573"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.447108 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260929 11:36:37.450572 17205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.451349 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260929 11:36:37.451660 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-0-root
uuid: "013a37bea2eb40c0ad4ce8f296176573"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.451982 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:36:37.475919 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:36:37.477236 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:36:37.478681 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:36:37.481046 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:36:37.481295 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.481566 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:36:37.481734 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.521488 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.193:35361
I20260929 11:36:37.521586 17267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.193:35361 every 8 connection(s)
I20260929 11:36:37.526424 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:36:37.533660 17272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:36:37.534402 17273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:36:37.537657 14199 server_base.cc:1034] running on GCE node
W20260929 11:36:37.538296 17275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:36:37.539479 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:36:37.539731 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:36:37.539925 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681797539908 us; error 0 us; skew 500 ppm
I20260929 11:36:37.540510 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:36:37.542423 17268 heartbeater.cc:347] Connected to a master server at 127.13.221.254:34761
I20260929 11:36:37.542809 17268 heartbeater.cc:464] Registering TS with master...
I20260929 11:36:37.543449 14199 webserver.cc:460] Webserver started at http://127.13.221.194:32865/ using document root <none> and password file <none>
I20260929 11:36:37.543493 17268 heartbeater.cc:511] Master 127.13.221.254:34761 requested a full tablet report, sending...
I20260929 11:36:37.544088 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:36:37.544309 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:36:37.544638 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:36:37.545665 17141 ts_manager.cc:194] Registered new tserver with Master: 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:37.545722 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/instance:
uuid: "a7e500c82a21469ab59f66205205a12a"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.547933 17141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41934
I20260929 11:36:37.550648 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260929 11:36:37.554276 17280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.555044 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260929 11:36:37.555341 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-1-root
uuid: "a7e500c82a21469ab59f66205205a12a"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.555635 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:36:37.570712 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:36:37.571983 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:36:37.573450 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:36:37.575665 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:36:37.575882 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.576155 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:36:37.576287 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.616194 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.194:35795
I20260929 11:36:37.616291 17342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.194:35795 every 8 connection(s)
I20260929 11:36:37.621378 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:36:37.629453 17346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:36:37.630688 17347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:36:37.634744 14199 server_base.cc:1034] running on GCE node
W20260929 11:36:37.634744 17349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:36:37.636227 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260929 11:36:37.636507 17343 heartbeater.cc:347] Connected to a master server at 127.13.221.254:34761
W20260929 11:36:37.636663 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:36:37.636902 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681797636882 us; error 0 us; skew 500 ppm
I20260929 11:36:37.636925 17343 heartbeater.cc:464] Registering TS with master...
I20260929 11:36:37.637741 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:36:37.637929 17343 heartbeater.cc:511] Master 127.13.221.254:34761 requested a full tablet report, sending...
I20260929 11:36:37.640151 17141 ts_manager.cc:194] Registered new tserver with Master: a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:37.640734 14199 webserver.cc:460] Webserver started at http://127.13.221.195:44065/ using document root <none> and password file <none>
I20260929 11:36:37.641266 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:36:37.641479 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:36:37.641746 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:36:37.642032 17141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41940
I20260929 11:36:37.642939 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/instance:
uuid: "bb8e3505668b40219823840c0d8bc3af"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.647419 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260929 11:36:37.650779 17354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.651675 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260929 11:36:37.651954 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-2-root
uuid: "bb8e3505668b40219823840c0d8bc3af"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.652237 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:36:37.679723 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:36:37.681051 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:36:37.682327 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:36:37.684777 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:36:37.684994 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.685263 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:36:37.685425 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.725616 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.195:33835
I20260929 11:36:37.725715 17416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.195:33835 every 8 connection(s)
I20260929 11:36:37.730280 14199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260929 11:36:37.737977 17420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:36:37.739022 17421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260929 11:36:37.740978 17423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260929 11:36:37.742326 14199 server_base.cc:1034] running on GCE node
I20260929 11:36:37.743484 14199 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260929 11:36:37.743762 14199 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260929 11:36:37.743968 14199 hybrid_clock.cc:648] HybridClock initialized: now 1790681797743951 us; error 0 us; skew 500 ppm
I20260929 11:36:37.744582 14199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260929 11:36:37.745621 17417 heartbeater.cc:347] Connected to a master server at 127.13.221.254:34761
I20260929 11:36:37.746040 17417 heartbeater.cc:464] Registering TS with master...
I20260929 11:36:37.746703 17417 heartbeater.cc:511] Master 127.13.221.254:34761 requested a full tablet report, sending...
I20260929 11:36:37.747411 14199 webserver.cc:460] Webserver started at http://127.13.221.196:36073/ using document root <none> and password file <none>
I20260929 11:36:37.748034 14199 fs_manager.cc:359] Metadata directory not provided
I20260929 11:36:37.748270 14199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260929 11:36:37.748626 14199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260929 11:36:37.748939 17141 ts_manager.cc:194] Registered new tserver with Master: bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:37.749822 14199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-3-root/instance:
uuid: "26cd298fcaa34c9f93d8793e64f0e863"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.750588 17141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41942
I20260929 11:36:37.754889 14199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260929 11:36:37.758270 17428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.758947 14199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260929 11:36:37.759332 14199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-3-root
uuid: "26cd298fcaa34c9f93d8793e64f0e863"
format_stamp: "Formatted at 2026-09-29 11:36:37 on dist-test-slave-szp1"
I20260929 11:36:37.759610 14199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0cZB5n/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790681683607964-14199-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260929 11:36:37.786566 14199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260929 11:36:37.787878 14199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260929 11:36:37.789179 14199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260929 11:36:37.791826 14199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260929 11:36:37.792176 14199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.792487 14199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260929 11:36:37.792673 14199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260929 11:36:37.832211 14199 rpc_server.cc:307] RPC server started. Bound to: 127.13.221.196:39599
I20260929 11:36:37.832392 17490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.221.196:39599 every 8 connection(s)
I20260929 11:36:37.847740 17491 heartbeater.cc:347] Connected to a master server at 127.13.221.254:34761
I20260929 11:36:37.848188 17491 heartbeater.cc:464] Registering TS with master...
I20260929 11:36:37.848902 17491 heartbeater.cc:511] Master 127.13.221.254:34761 requested a full tablet report, sending...
I20260929 11:36:37.850834 17141 ts_manager.cc:194] Registered new tserver with Master: 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:37.851440 14199 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016097194s
I20260929 11:36:37.852684 17141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41956
I20260929 11:36:37.853932 14199 test_util.cc:268] Using random seed: -1736998189
I20260929 11:36:37.880829 17141 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41970:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260929 11:36:38.137001 17452 tablet_service.cc:1467] Processing CreateTablet for tablet db5a4fd4ad3a4bba9a69926ef6ba204d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260929 11:36:38.137240 17451 tablet_service.cc:1467] Processing CreateTablet for tablet b191832c71294d9c9c742c66bd25c2b6 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260929 11:36:38.138614 17452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5a4fd4ad3a4bba9a69926ef6ba204d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.139119 17453 tablet_service.cc:1467] Processing CreateTablet for tablet c5714036d5174aaf8365d9e64517c5e0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260929 11:36:38.141484 17454 tablet_service.cc:1467] Processing CreateTablet for tablet 6e1e2488d0f744f5913ac947362f1e27 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260929 11:36:38.143648 17455 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8d27c3483f4e0eadb60439434a5faa (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260929 11:36:38.145812 17456 tablet_service.cc:1467] Processing CreateTablet for tablet af251f3277b7413d8197acd312513289 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260929 11:36:38.146236 17450 tablet_service.cc:1467] Processing CreateTablet for tablet 0c1a5e3d37784c8c866702270fbb2ca6 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260929 11:36:38.147671 17453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5714036d5174aaf8365d9e64517c5e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.148473 17381 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8d27c3483f4e0eadb60439434a5faa (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260929 11:36:38.149473 17373 tablet_service.cc:1467] Processing CreateTablet for tablet 9d04716ced464bc8b01430636a571cdd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260929 11:36:38.149838 17374 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9454302f224c02a4a0d6a44ffaf3a0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260929 11:36:38.151038 17375 tablet_service.cc:1467] Processing CreateTablet for tablet edae75a1c2e04d0d9d7a5e7e26fcdcce (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260929 11:36:38.151990 17376 tablet_service.cc:1467] Processing CreateTablet for tablet 6108e0155a134589a2d418b9fedbe6ca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260929 11:36:38.152734 17455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8d27c3483f4e0eadb60439434a5faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.154157 17377 tablet_service.cc:1467] Processing CreateTablet for tablet b191832c71294d9c9c742c66bd25c2b6 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260929 11:36:38.156250 17378 tablet_service.cc:1467] Processing CreateTablet for tablet db5a4fd4ad3a4bba9a69926ef6ba204d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260929 11:36:38.157382 17456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af251f3277b7413d8197acd312513289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.158314 17379 tablet_service.cc:1467] Processing CreateTablet for tablet ef22bce609f94dd4b4c3f039c01e473e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260929 11:36:38.160545 17380 tablet_service.cc:1467] Processing CreateTablet for tablet 6e1e2488d0f744f5913ac947362f1e27 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260929 11:36:38.161466 17454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e1e2488d0f744f5913ac947362f1e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.162657 17382 tablet_service.cc:1467] Processing CreateTablet for tablet 27f6e0507d9c4264842d9efd8606b256 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260929 11:36:38.164073 17450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c1a5e3d37784c8c866702270fbb2ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.149871 17381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8d27c3483f4e0eadb60439434a5faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.165150 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27f6e0507d9c4264842d9efd8606b256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.165803 17375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edae75a1c2e04d0d9d7a5e7e26fcdcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.168653 17379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef22bce609f94dd4b4c3f039c01e473e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.169258 17373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d04716ced464bc8b01430636a571cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.169857 17378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5a4fd4ad3a4bba9a69926ef6ba204d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.172626 17451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b191832c71294d9c9c742c66bd25c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.176000 17376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6108e0155a134589a2d418b9fedbe6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.177322 17377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b191832c71294d9c9c742c66bd25c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.178761 17374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9454302f224c02a4a0d6a44ffaf3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.180187 17380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e1e2488d0f744f5913ac947362f1e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.184808 17449 tablet_service.cc:1467] Processing CreateTablet for tablet edae75a1c2e04d0d9d7a5e7e26fcdcce (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260929 11:36:38.193972 17448 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9454302f224c02a4a0d6a44ffaf3a0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260929 11:36:38.199151 17308 tablet_service.cc:1467] Processing CreateTablet for tablet af251f3277b7413d8197acd312513289 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260929 11:36:38.201370 17303 tablet_service.cc:1467] Processing CreateTablet for tablet b191832c71294d9c9c742c66bd25c2b6 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260929 11:36:38.202860 17303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b191832c71294d9c9c742c66bd25c2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.202598 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 6e1e2488d0f744f5913ac947362f1e27 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260929 11:36:38.203917 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e1e2488d0f744f5913ac947362f1e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.204962 17302 tablet_service.cc:1467] Processing CreateTablet for tablet 6108e0155a134589a2d418b9fedbe6ca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260929 11:36:38.205493 17305 tablet_service.cc:1467] Processing CreateTablet for tablet ef22bce609f94dd4b4c3f039c01e473e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260929 11:36:38.206336 17302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6108e0155a134589a2d418b9fedbe6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.207667 17304 tablet_service.cc:1467] Processing CreateTablet for tablet c5714036d5174aaf8365d9e64517c5e0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260929 11:36:38.211122 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5714036d5174aaf8365d9e64517c5e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.211941 17300 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9454302f224c02a4a0d6a44ffaf3a0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260929 11:36:38.213346 17300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9454302f224c02a4a0d6a44ffaf3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.217990 17299 tablet_service.cc:1467] Processing CreateTablet for tablet 9d04716ced464bc8b01430636a571cdd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260929 11:36:38.219449 17299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d04716ced464bc8b01430636a571cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.221639 17374 tablet_service.cc:1467] Processing CreateTablet for tablet 8b65856aeb514b6e9688762800e2e9fb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260929 11:36:38.201465 17307 tablet_service.cc:1467] Processing CreateTablet for tablet 27f6e0507d9c4264842d9efd8606b256 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260929 11:36:38.196339 17447 tablet_service.cc:1467] Processing CreateTablet for tablet 95a01f47e3bb47bea991cd4475dfb89f (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260929 11:36:38.209718 17301 tablet_service.cc:1467] Processing CreateTablet for tablet 0c1a5e3d37784c8c866702270fbb2ca6 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260929 11:36:38.222950 17374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b65856aeb514b6e9688762800e2e9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.223145 17307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27f6e0507d9c4264842d9efd8606b256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.223842 17301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c1a5e3d37784c8c866702270fbb2ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.224495 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef22bce609f94dd4b4c3f039c01e473e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.228744 17308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af251f3277b7413d8197acd312513289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.186241 17449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edae75a1c2e04d0d9d7a5e7e26fcdcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.236722 17448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9454302f224c02a4a0d6a44ffaf3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.239709 17447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95a01f47e3bb47bea991cd4475dfb89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.271718 17451 tablet_service.cc:1467] Processing CreateTablet for tablet 8b65856aeb514b6e9688762800e2e9fb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260929 11:36:38.272817 17233 tablet_service.cc:1467] Processing CreateTablet for tablet af251f3277b7413d8197acd312513289 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260929 11:36:38.314536 17233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af251f3277b7413d8197acd312513289. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.274523 17232 tablet_service.cc:1467] Processing CreateTablet for tablet 27f6e0507d9c4264842d9efd8606b256 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260929 11:36:38.317502 17232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27f6e0507d9c4264842d9efd8606b256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.318671 17381 tablet_service.cc:1467] Processing CreateTablet for tablet c2fa1c2d5ef24a278619dbf6b3a135ab (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260929 11:36:38.320048 17381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2fa1c2d5ef24a278619dbf6b3a135ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.276240 17231 tablet_service.cc:1467] Processing CreateTablet for tablet 2f8d27c3483f4e0eadb60439434a5faa (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260929 11:36:38.321494 17231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f8d27c3483f4e0eadb60439434a5faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.277968 17230 tablet_service.cc:1467] Processing CreateTablet for tablet ef22bce609f94dd4b4c3f039c01e473e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260929 11:36:38.325085 17451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b65856aeb514b6e9688762800e2e9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.281548 17228 tablet_service.cc:1467] Processing CreateTablet for tablet db5a4fd4ad3a4bba9a69926ef6ba204d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260929 11:36:38.283205 17227 tablet_service.cc:1467] Processing CreateTablet for tablet 6108e0155a134589a2d418b9fedbe6ca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260929 11:36:38.283735 17304 tablet_service.cc:1467] Processing CreateTablet for tablet 95a01f47e3bb47bea991cd4475dfb89f (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260929 11:36:38.285871 17511 tablet_bootstrap.cc:492] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:38.285722 17226 tablet_service.cc:1467] Processing CreateTablet for tablet 0c1a5e3d37784c8c866702270fbb2ca6 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260929 11:36:38.286202 17225 tablet_service.cc:1467] Processing CreateTablet for tablet edae75a1c2e04d0d9d7a5e7e26fcdcce (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
W20260929 11:36:38.290009 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:38.292497 17224 tablet_service.cc:1467] Processing CreateTablet for tablet 9d04716ced464bc8b01430636a571cdd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260929 11:36:38.293000 17379 tablet_service.cc:1467] Processing CreateTablet for tablet 791cc703ef754cb5a68316bbc895a05d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260929 11:36:38.297711 17374 tablet_service.cc:1467] Processing CreateTablet for tablet 59afcac98ed94a53805eab1321f05fea (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260929 11:36:38.308903 17373 tablet_service.cc:1467] Processing CreateTablet for tablet ac8d7cf3a0d84804ad52464db2fb53ca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260929 11:36:38.339167 17379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791cc703ef754cb5a68316bbc895a05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.325433 17230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef22bce609f94dd4b4c3f039c01e473e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.341063 17380 tablet_service.cc:1467] Processing CreateTablet for tablet 81a2704a8866420f844ab5f310c1e894 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260929 11:36:38.341795 17225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edae75a1c2e04d0d9d7a5e7e26fcdcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.342576 17227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6108e0155a134589a2d418b9fedbe6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.279793 17229 tablet_service.cc:1467] Processing CreateTablet for tablet c5714036d5174aaf8365d9e64517c5e0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260929 11:36:38.333791 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95a01f47e3bb47bea991cd4475dfb89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.345134 17229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5714036d5174aaf8365d9e64517c5e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.347386 17224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d04716ced464bc8b01430636a571cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.339982 17373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8d7cf3a0d84804ad52464db2fb53ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.348728 17226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c1a5e3d37784c8c866702270fbb2ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.363534 17511 tablet_bootstrap.cc:654] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:38.364751 17380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81a2704a8866420f844ab5f310c1e894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.368705 17228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db5a4fd4ad3a4bba9a69926ef6ba204d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.373638 17376 tablet_service.cc:1467] Processing CreateTablet for tablet 8c68e526f10e41d28e5d99b4d239f940 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260929 11:36:38.368813 17374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59afcac98ed94a53805eab1321f05fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.400745 17512 tablet_bootstrap.cc:492] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:38.403280 17378 tablet_service.cc:1467] Processing CreateTablet for tablet 1468df1420664db9972432b0042a2488 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260929 11:36:38.405237 17450 tablet_service.cc:1467] Processing CreateTablet for tablet 6520b46bbc094c889371e9c2ff6748bd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260929 11:36:38.406663 17450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6520b46bbc094c889371e9c2ff6748bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.406989 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 791cc703ef754cb5a68316bbc895a05d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260929 11:36:38.408277 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791cc703ef754cb5a68316bbc895a05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.415199 17453 tablet_service.cc:1467] Processing CreateTablet for tablet ac8d7cf3a0d84804ad52464db2fb53ca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260929 11:36:38.416632 17453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8d7cf3a0d84804ad52464db2fb53ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.433904 17376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c68e526f10e41d28e5d99b4d239f940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.434075 17454 tablet_service.cc:1467] Processing CreateTablet for tablet c2fa1c2d5ef24a278619dbf6b3a135ab (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260929 11:36:38.437057 17378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1468df1420664db9972432b0042a2488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.438988 17454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2fa1c2d5ef24a278619dbf6b3a135ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.445901 17447 tablet_service.cc:1467] Processing CreateTablet for tablet 40ff2f2b6de34730a98257133e3882a4 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260929 11:36:38.446383 17301 tablet_service.cc:1467] Processing CreateTablet for tablet 59afcac98ed94a53805eab1321f05fea (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260929 11:36:38.447250 17447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ff2f2b6de34730a98257133e3882a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.447651 17301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59afcac98ed94a53805eab1321f05fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.334185 17455 tablet_service.cc:1467] Processing CreateTablet for tablet 791cc703ef754cb5a68316bbc895a05d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260929 11:36:38.458320 17455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791cc703ef754cb5a68316bbc895a05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.463838 17302 tablet_service.cc:1467] Processing CreateTablet for tablet c2fa1c2d5ef24a278619dbf6b3a135ab (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260929 11:36:38.465237 17302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2fa1c2d5ef24a278619dbf6b3a135ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.466300 17300 tablet_service.cc:1467] Processing CreateTablet for tablet 8c68e526f10e41d28e5d99b4d239f940 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260929 11:36:38.467588 17300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c68e526f10e41d28e5d99b4d239f940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.476272 17307 tablet_service.cc:1467] Processing CreateTablet for tablet 40ff2f2b6de34730a98257133e3882a4 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260929 11:36:38.477233 17453 tablet_service.cc:1467] Processing CreateTablet for tablet 81a2704a8866420f844ab5f310c1e894 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260929 11:36:38.477681 17307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ff2f2b6de34730a98257133e3882a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.479529 17512 tablet_bootstrap.cc:654] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:38.481022 17513 tablet_bootstrap.cc:492] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:38.487053 17232 tablet_service.cc:1467] Processing CreateTablet for tablet 8b65856aeb514b6e9688762800e2e9fb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260929 11:36:38.494326 17382 tablet_service.cc:1467] Processing CreateTablet for tablet 0fbfc6a09e844768909a2044d9cb8066 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260929 11:36:38.495740 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fbfc6a09e844768909a2044d9cb8066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.502668 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 6520b46bbc094c889371e9c2ff6748bd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260929 11:36:38.503502 17515 tablet_bootstrap.cc:492] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:38.510310 17513 tablet_bootstrap.cc:654] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:38.511034 17511 tablet_bootstrap.cc:492] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:38.511530 17511 ts_tablet_manager.cc:1397] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.226s user 0.011s sys 0.002s
I20260929 11:36:38.513019 17456 tablet_service.cc:1467] Processing CreateTablet for tablet 66c38ca223cc4337b527ebd9abd29cd5 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260929 11:36:38.507550 17452 tablet_service.cc:1467] Processing CreateTablet for tablet 1468df1420664db9972432b0042a2488 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260929 11:36:38.508404 17453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81a2704a8866420f844ab5f310c1e894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.509193 17377 tablet_service.cc:1467] Processing CreateTablet for tablet 9eaaf8a15b5b4aa3ac199ce1509f3110 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260929 11:36:38.528147 17449 tablet_service.cc:1467] Processing CreateTablet for tablet 9eaaf8a15b5b4aa3ac199ce1509f3110 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260929 11:36:38.529325 17377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eaaf8a15b5b4aa3ac199ce1509f3110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.529453 17449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eaaf8a15b5b4aa3ac199ce1509f3110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.509112 17224 tablet_service.cc:1467] Processing CreateTablet for tablet 95a01f47e3bb47bea991cd4475dfb89f (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260929 11:36:38.513705 17379 tablet_service.cc:1467] Processing CreateTablet for tablet cb100fbaa5d4434c9b62299d39e52992 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260929 11:36:38.533061 17452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1468df1420664db9972432b0042a2488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.533864 17379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb100fbaa5d4434c9b62299d39e52992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.536633 17304 tablet_service.cc:1467] Processing CreateTablet for tablet 1468df1420664db9972432b0042a2488 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260929 11:36:38.515291 17381 tablet_service.cc:1467] Processing CreateTablet for tablet 2303ddc899e94157b6c5ad7185a7a9bc (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260929 11:36:38.542341 17511 raft_consensus.cc:348] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:38.543180 17511 raft_consensus.cc:374] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:38.543503 17511 raft_consensus.cc:729] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:38.543592 17381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2303ddc899e94157b6c5ad7185a7a9bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.504050 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6520b46bbc094c889371e9c2ff6748bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.551080 17456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c38ca223cc4337b527ebd9abd29cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.551213 17268 heartbeater.cc:503] Master 127.13.221.254:34761 was elected leader, sending a full tablet report...
I20260929 11:36:38.553664 17299 tablet_service.cc:1467] Processing CreateTablet for tablet 0fbfc6a09e844768909a2044d9cb8066 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260929 11:36:38.555243 17299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fbfc6a09e844768909a2044d9cb8066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.544380 17232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b65856aeb514b6e9688762800e2e9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.564425 17224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95a01f47e3bb47bea991cd4475dfb89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.570554 17231 tablet_service.cc:1467] Processing CreateTablet for tablet 8c68e526f10e41d28e5d99b4d239f940 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260929 11:36:38.572052 17231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c68e526f10e41d28e5d99b4d239f940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.564060 17308 tablet_service.cc:1467] Processing CreateTablet for tablet 66c38ca223cc4337b527ebd9abd29cd5 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260929 11:36:38.598459 17227 tablet_service.cc:1467] Processing CreateTablet for tablet 59afcac98ed94a53805eab1321f05fea (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260929 11:36:38.599896 17227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59afcac98ed94a53805eab1321f05fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.600500 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1468df1420664db9972432b0042a2488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.544270 17511 consensus_queue.cc:260] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:38.614084 17225 tablet_service.cc:1467] Processing CreateTablet for tablet 40ff2f2b6de34730a98257133e3882a4 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260929 11:36:38.617163 17303 tablet_service.cc:1467] Processing CreateTablet for tablet cb100fbaa5d4434c9b62299d39e52992 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260929 11:36:38.606240 17233 tablet_service.cc:1467] Processing CreateTablet for tablet 6520b46bbc094c889371e9c2ff6748bd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260929 11:36:38.620609 17229 tablet_service.cc:1467] Processing CreateTablet for tablet 81a2704a8866420f844ab5f310c1e894 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260929 11:36:38.622087 17230 tablet_service.cc:1467] Processing CreateTablet for tablet ac8d7cf3a0d84804ad52464db2fb53ca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260929 11:36:38.564060 17375 tablet_service.cc:1467] Processing CreateTablet for tablet bdf4a53492b14021977a532a11216ba2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260929 11:36:38.623104 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 2303ddc899e94157b6c5ad7185a7a9bc (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260929 11:36:38.623781 17375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdf4a53492b14021977a532a11216ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.629694 17380 tablet_service.cc:1467] Processing CreateTablet for tablet 84d908c031db44039f013807daaa3507 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260929 11:36:38.630088 17450 tablet_service.cc:1467] Processing CreateTablet for tablet cb100fbaa5d4434c9b62299d39e52992 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260929 11:36:38.631111 17380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d908c031db44039f013807daaa3507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.631371 17450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb100fbaa5d4434c9b62299d39e52992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.631758 17448 tablet_service.cc:1467] Processing CreateTablet for tablet af63fc2fec1c4842a27dea066965a988 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260929 11:36:38.633006 17308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c38ca223cc4337b527ebd9abd29cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.640929 17373 tablet_service.cc:1467] Processing CreateTablet for tablet 9c712464fc6c4fb7b3b479dd59774f1a (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260929 11:36:38.642387 17373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c712464fc6c4fb7b3b479dd59774f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.644014 17513 tablet_bootstrap.cc:492] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:38.644896 17343 heartbeater.cc:503] Master 127.13.221.254:34761 was elected leader, sending a full tablet report...
I20260929 11:36:38.646184 17454 tablet_service.cc:1467] Processing CreateTablet for tablet bdf4a53492b14021977a532a11216ba2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260929 11:36:38.647495 17454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdf4a53492b14021977a532a11216ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.638170 17515 tablet_bootstrap.cc:654] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:38.658581 17513 ts_tablet_manager.cc:1397] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.178s user 0.014s sys 0.008s
I20260929 11:36:38.666356 17226 tablet_service.cc:1467] Processing CreateTablet for tablet 66c38ca223cc4337b527ebd9abd29cd5 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260929 11:36:38.661789 17225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40ff2f2b6de34730a98257133e3882a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.672991 17230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8d7cf3a0d84804ad52464db2fb53ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.675081 17226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c38ca223cc4337b527ebd9abd29cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.674737 17378 tablet_service.cc:1467] Processing CreateTablet for tablet 8232a146a4ae4a84b9292eab399fd1cb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260929 11:36:38.676749 17378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8232a146a4ae4a84b9292eab399fd1cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.656785 17303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb100fbaa5d4434c9b62299d39e52992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.648859 17228 tablet_service.cc:1467] Processing CreateTablet for tablet 0fbfc6a09e844768909a2044d9cb8066 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260929 11:36:38.695523 17512 tablet_bootstrap.cc:492] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:38.682145 17233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6520b46bbc094c889371e9c2ff6748bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.686892 17448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af63fc2fec1c4842a27dea066965a988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.705456 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2303ddc899e94157b6c5ad7185a7a9bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.702484 17512 ts_tablet_manager.cc:1397] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.302s user 0.009s sys 0.014s
I20260929 11:36:38.705425 17301 tablet_service.cc:1467] Processing CreateTablet for tablet 84d908c031db44039f013807daaa3507 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260929 11:36:38.708681 17301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d908c031db44039f013807daaa3507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.709959 17512 raft_consensus.cc:348] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:38.710765 17512 raft_consensus.cc:374] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:38.711073 17512 raft_consensus.cc:729] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:38.712733 17376 tablet_service.cc:1467] Processing CreateTablet for tablet bad8c633e7dd41be8d3c15ae27c52240 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260929 11:36:38.713207 17451 tablet_service.cc:1467] Processing CreateTablet for tablet 84d908c031db44039f013807daaa3507 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260929 11:36:38.714243 17376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bad8c633e7dd41be8d3c15ae27c52240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.714552 17511 ts_tablet_manager.cc:1428] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.203s user 0.019s sys 0.019s
I20260929 11:36:38.715359 17417 heartbeater.cc:503] Master 127.13.221.254:34761 was elected leader, sending a full tablet report...
I20260929 11:36:38.716871 17374 tablet_service.cc:1467] Processing CreateTablet for tablet 99e908ebf22e447487392401adf8bfd8 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260929 11:36:38.718804 17374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e908ebf22e447487392401adf8bfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.721664 17511 tablet_bootstrap.cc:492] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:38.723613 17302 tablet_service.cc:1467] Processing CreateTablet for tablet af63fc2fec1c4842a27dea066965a988 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260929 11:36:38.723631 17228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fbfc6a09e844768909a2044d9cb8066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.725203 17302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af63fc2fec1c4842a27dea066965a988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.725793 17512 consensus_queue.cc:260] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:38.726953 17229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81a2704a8866420f844ab5f310c1e894. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:36:38.730178 17418 tablet.cc:2369] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260929 11:36:38.757797 17447 tablet_service.cc:1467] Processing CreateTablet for tablet c376551ad71d48f9b08315025561869e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260929 11:36:38.761799 17451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84d908c031db44039f013807daaa3507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.790066 17513 raft_consensus.cc:348] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:38.790977 17513 raft_consensus.cc:374] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:38.791290 17513 raft_consensus.cc:729] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:38.805204 17299 tablet_service.cc:1467] Processing CreateTablet for tablet c376551ad71d48f9b08315025561869e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260929 11:36:38.806596 17299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c376551ad71d48f9b08315025561869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.809890 17491 heartbeater.cc:503] Master 127.13.221.254:34761 was elected leader, sending a full tablet report...
I20260929 11:36:38.815402 17307 tablet_service.cc:1467] Processing CreateTablet for tablet bad8c633e7dd41be8d3c15ae27c52240 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260929 11:36:38.829160 17307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bad8c633e7dd41be8d3c15ae27c52240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.820917 17511 tablet_bootstrap.cc:654] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:38.829032 17300 tablet_service.cc:1467] Processing CreateTablet for tablet 9c712464fc6c4fb7b3b479dd59774f1a (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260929 11:36:38.829963 17515 tablet_bootstrap.cc:492] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:38.847972 17515 ts_tablet_manager.cc:1397] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.345s user 0.024s sys 0.000s
I20260929 11:36:38.851042 17515 raft_consensus.cc:348] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:38.817310 17382 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3002f11c7a4c27b73e9842ce11ee63 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260929 11:36:38.857928 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e3002f11c7a4c27b73e9842ce11ee63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.835407 17512 ts_tablet_manager.cc:1428] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.128s user 0.004s sys 0.008s
I20260929 11:36:38.861326 17512 tablet_bootstrap.cc:492] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:38.792022 17513 consensus_queue.cc:260] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:38.839659 17447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c376551ad71d48f9b08315025561869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.831921 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 99e908ebf22e447487392401adf8bfd8 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260929 11:36:38.876829 17125 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 45384.8us
I20260929 11:36:38.882020 17449 tablet_service.cc:1467] Processing CreateTablet for tablet 8232a146a4ae4a84b9292eab399fd1cb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260929 11:36:38.883396 17449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8232a146a4ae4a84b9292eab399fd1cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.885417 17224 tablet_service.cc:1467] Processing CreateTablet for tablet 9eaaf8a15b5b4aa3ac199ce1509f3110 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260929 11:36:38.886721 17224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eaaf8a15b5b4aa3ac199ce1509f3110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.894869 17455 tablet_service.cc:1467] Processing CreateTablet for tablet bad8c633e7dd41be8d3c15ae27c52240 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260929 11:36:38.898144 17454 tablet_service.cc:1467] Processing CreateTablet for tablet dda74a7e6ff64812814139f0aedd4baf (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260929 11:36:38.901360 17452 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3002f11c7a4c27b73e9842ce11ee63 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260929 11:36:38.902662 17452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e3002f11c7a4c27b73e9842ce11ee63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.920588 17230 tablet_service.cc:1467] Processing CreateTablet for tablet 2303ddc899e94157b6c5ad7185a7a9bc (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260929 11:36:38.922001 17230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2303ddc899e94157b6c5ad7185a7a9bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.925352 17232 tablet_service.cc:1467] Processing CreateTablet for tablet af63fc2fec1c4842a27dea066965a988 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260929 11:36:38.926729 17232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af63fc2fec1c4842a27dea066965a988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.904479 17515 raft_consensus.cc:374] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:38.942032 17518 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:38.942777 17518 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:38.946163 17518 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:38.946751 17454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda74a7e6ff64812814139f0aedd4baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.948908 17515 raft_consensus.cc:729] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:38.962447 17455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bad8c633e7dd41be8d3c15ae27c52240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.975493 17380 tablet_service.cc:1467] Processing CreateTablet for tablet a69cd2eecec44c94912facf79cbb066e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260929 11:36:38.978631 17512 tablet_bootstrap.cc:654] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:38.979377 17515 consensus_queue.cc:260] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:38.979980 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e908ebf22e447487392401adf8bfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.996889 17300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c712464fc6c4fb7b3b479dd59774f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.981123 17511 tablet_bootstrap.cc:492] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:38.979316 17308 tablet_service.cc:1467] Processing CreateTablet for tablet a69cd2eecec44c94912facf79cbb066e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260929 11:36:39.000828 17511 ts_tablet_manager.cc:1397] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.279s user 0.014s sys 0.025s
I20260929 11:36:39.001325 17308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a69cd2eecec44c94912facf79cbb066e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.001549 17227 tablet_service.cc:1467] Processing CreateTablet for tablet 9c712464fc6c4fb7b3b479dd59774f1a (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260929 11:36:39.002846 17227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c712464fc6c4fb7b3b479dd59774f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.984875 17304 tablet_service.cc:1467] Processing CreateTablet for tablet dda74a7e6ff64812814139f0aedd4baf (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260929 11:36:38.986161 17513 ts_tablet_manager.cc:1428] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.317s user 0.001s sys 0.019s
I20260929 11:36:38.986290 17451 tablet_service.cc:1467] Processing CreateTablet for tablet a69cd2eecec44c94912facf79cbb066e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260929 11:36:38.992156 17380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a69cd2eecec44c94912facf79cbb066e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.007915 17513 tablet_bootstrap.cc:492] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:39.010394 17301 tablet_service.cc:1467] Processing CreateTablet for tablet 3c629677b9d54b97a292b8e5388288eb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260929 11:36:39.010970 17519 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:39.011951 17301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c629677b9d54b97a292b8e5388288eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.011546 17519 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:39.012950 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda74a7e6ff64812814139f0aedd4baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:38.984068 17231 tablet_service.cc:1467] Processing CreateTablet for tablet bdf4a53492b14021977a532a11216ba2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260929 11:36:39.003737 17511 raft_consensus.cc:348] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:39.030118 17515 ts_tablet_manager.cc:1428] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.182s user 0.007s sys 0.008s
I20260929 11:36:39.031278 17519 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:39.019927 17511 raft_consensus.cc:374] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:39.037454 17448 tablet_service.cc:1467] Processing CreateTablet for tablet 4f710cc4eabc43cb9d15d956a7d405ec (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260929 11:36:39.039117 17515 tablet_bootstrap.cc:492] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:39.031572 17231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdf4a53492b14021977a532a11216ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.034808 17511 raft_consensus.cc:729] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:39.053977 17307 tablet_service.cc:1467] Processing CreateTablet for tablet 4f710cc4eabc43cb9d15d956a7d405ec (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260929 11:36:39.055263 17374 tablet_service.cc:1467] Processing CreateTablet for tablet ec0779c5ab5f4982ac77456eafc8a9e7 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260929 11:36:39.056661 17374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec0779c5ab5f4982ac77456eafc8a9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.057482 17376 tablet_service.cc:1467] Processing CreateTablet for tablet 3c629677b9d54b97a292b8e5388288eb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260929 11:36:39.058729 17376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c629677b9d54b97a292b8e5388288eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.055325 17307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f710cc4eabc43cb9d15d956a7d405ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.061434 17511 consensus_queue.cc:260] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:39.063012 17513 tablet_bootstrap.cc:654] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:39.063663 17511 ts_tablet_manager.cc:1428] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.062s user 0.006s sys 0.001s
I20260929 11:36:39.070587 17373 tablet_service.cc:1467] Processing CreateTablet for tablet 1df496b2ead6419983ffed1627fb69f9 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260929 11:36:39.073733 17373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df496b2ead6419983ffed1627fb69f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.076635 17299 tablet_service.cc:1467] Processing CreateTablet for tablet 1df496b2ead6419983ffed1627fb69f9 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260929 11:36:39.074302 17381 tablet_service.cc:1467] Processing CreateTablet for tablet db3516ecd8394495878d2f749d8fa27d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260929 11:36:39.079329 17381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db3516ecd8394495878d2f749d8fa27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.079694 17456 tablet_service.cc:1467] Processing CreateTablet for tablet ec0779c5ab5f4982ac77456eafc8a9e7 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260929 11:36:39.080365 17450 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5e6ddd0e1143509bc667ce0d157fca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260929 11:36:39.081670 17449 tablet_service.cc:1467] Processing CreateTablet for tablet 1df496b2ead6419983ffed1627fb69f9 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260929 11:36:39.082903 17228 tablet_service.cc:1467] Processing CreateTablet for tablet c376551ad71d48f9b08315025561869e (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260929 11:36:39.051275 17451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a69cd2eecec44c94912facf79cbb066e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.093176 17453 tablet_service.cc:1467] Processing CreateTablet for tablet 35275d14d1b4485fbb03887df828daa2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260929 11:36:39.094991 17229 tablet_service.cc:1467] Processing CreateTablet for tablet 8232a146a4ae4a84b9292eab399fd1cb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260929 11:36:39.102173 17303 tablet_service.cc:1467] Processing CreateTablet for tablet db3516ecd8394495878d2f749d8fa27d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260929 11:36:39.103453 17303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db3516ecd8394495878d2f749d8fa27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.104125 17299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df496b2ead6419983ffed1627fb69f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.105348 17302 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5e6ddd0e1143509bc667ce0d157fca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260929 11:36:39.106583 17302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5e6ddd0e1143509bc667ce0d157fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.111738 17511 tablet_bootstrap.cc:492] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:39.116298 17228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c376551ad71d48f9b08315025561869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.118963 17229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8232a146a4ae4a84b9292eab399fd1cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.120131 17226 tablet_service.cc:1467] Processing CreateTablet for tablet 99e908ebf22e447487392401adf8bfd8 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260929 11:36:39.124713 17378 tablet_service.cc:1467] Processing CreateTablet for tablet 35275d14d1b4485fbb03887df828daa2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260929 11:36:39.126322 17378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35275d14d1b4485fbb03887df828daa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.135128 17225 tablet_service.cc:1467] Processing CreateTablet for tablet dda74a7e6ff64812814139f0aedd4baf (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260929 11:36:39.135913 17233 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3002f11c7a4c27b73e9842ce11ee63 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260929 11:36:39.140165 17518 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:39.140826 17518 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:39.150278 17450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5e6ddd0e1143509bc667ce0d157fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.156205 17522 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:39.156924 17522 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.168803 17226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99e908ebf22e447487392401adf8bfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.160154 17456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec0779c5ab5f4982ac77456eafc8a9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.172149 17453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35275d14d1b4485fbb03887df828daa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.174401 17448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f710cc4eabc43cb9d15d956a7d405ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.176664 17449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1df496b2ead6419983ffed1627fb69f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.183478 17512 tablet_bootstrap.cc:492] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:39.186220 17512 ts_tablet_manager.cc:1397] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.325s user 0.005s sys 0.026s
I20260929 11:36:39.197098 17225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dda74a7e6ff64812814139f0aedd4baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.200271 17232 tablet_service.cc:1467] Processing CreateTablet for tablet 3c629677b9d54b97a292b8e5388288eb (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260929 11:36:39.204758 17233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e3002f11c7a4c27b73e9842ce11ee63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.208650 17232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c629677b9d54b97a292b8e5388288eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.214478 17231 tablet_service.cc:1467] Processing CreateTablet for tablet 4f710cc4eabc43cb9d15d956a7d405ec (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260929 11:36:39.218690 17231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f710cc4eabc43cb9d15d956a7d405ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:36:39.216508 17127 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 72743.5us
I20260929 11:36:39.231943 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 930114cd75514fedbbd5bdfe525080f4 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260929 11:36:39.263592 17515 tablet_bootstrap.cc:654] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:39.248528 17518 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:39.305155 17513 tablet_bootstrap.cc:492] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:39.290124 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 0600a8955396487994f093e8edbd8ac0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260929 11:36:39.305932 17513 ts_tablet_manager.cc:1397] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.298s user 0.018s sys 0.045s
I20260929 11:36:39.272308 17511 tablet_bootstrap.cc:654] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:39.319043 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930114cd75514fedbbd5bdfe525080f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.377449 17512 raft_consensus.cc:348] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:39.277096 17452 tablet_service.cc:1467] Processing CreateTablet for tablet 930114cd75514fedbbd5bdfe525080f4 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260929 11:36:39.379086 17452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930114cd75514fedbbd5bdfe525080f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.379776 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0600a8955396487994f093e8edbd8ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.325227 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:39.327996 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:39.382606 17318 raft_consensus.cc:2454] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:39.328969 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:39.384833 17357 leader_election.cc:341] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.385964 17355 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:39.386832 17518 raft_consensus.cc:2781] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:39.387197 17518 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:39.387558 17518 raft_consensus.cc:3037] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:39.387620 17512 raft_consensus.cc:374] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:39.388182 17512 raft_consensus.cc:729] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:39.344513 17522 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:39.345681 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260929 11:36:39.344532 17127 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 44475.3us
I20260929 11:36:39.389273 17231 tablet_service.cc:1467] Processing CreateTablet for tablet 3d5e6ddd0e1143509bc667ce0d157fca (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260929 11:36:39.390592 17231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d5e6ddd0e1143509bc667ce0d157fca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:36:39.387195 17355 leader_election.cc:341] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.395129 17518 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.396119 17380 tablet_service.cc:1467] Processing CreateTablet for tablet ef0ba93c758b44c68b9eebc4712f42cd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260929 11:36:39.397449 17380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef0ba93c758b44c68b9eebc4712f42cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.395134 17454 tablet_service.cc:1467] Processing CreateTablet for tablet ef0ba93c758b44c68b9eebc4712f42cd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260929 11:36:39.398988 17454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef0ba93c758b44c68b9eebc4712f42cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.348264 17224 tablet_service.cc:1467] Processing CreateTablet for tablet ec0779c5ab5f4982ac77456eafc8a9e7 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260929 11:36:39.365764 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:39.400620 17224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec0779c5ab5f4982ac77456eafc8a9e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.398303 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:39.401490 17317 raft_consensus.cc:3037] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:39.283560 17304 tablet_service.cc:1467] Processing CreateTablet for tablet a1525efb73cb41699f311d353ec85272 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260929 11:36:39.404279 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1525efb73cb41699f311d353ec85272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.405221 17518 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:39.394936 17381 tablet_service.cc:1467] Processing CreateTablet for tablet a1525efb73cb41699f311d353ec85272 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260929 11:36:39.409413 17381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1525efb73cb41699f311d353ec85272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.324131 17447 tablet_service.cc:1467] Processing CreateTablet for tablet 0600a8955396487994f093e8edbd8ac0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260929 11:36:39.398809 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:39.413712 17447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0600a8955396487994f093e8edbd8ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.400550 17382 tablet_service.cc:1467] Processing CreateTablet for tablet ece37243cd8c44acaf6b92a5deb1274d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260929 11:36:39.415637 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ece37243cd8c44acaf6b92a5deb1274d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.416692 17449 tablet_service.cc:1467] Processing CreateTablet for tablet 7466b008788c41588274cefe10e78185 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260929 11:36:39.368081 17451 tablet_service.cc:1467] Processing CreateTablet for tablet 119bbba610844188b3191eb62136fae2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260929 11:36:39.414542 17357 leader_election.cc:341] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.420542 17455 tablet_service.cc:1467] Processing CreateTablet for tablet 96828e8ec02b4abe91b7c6328a84d114 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260929 11:36:39.421759 17455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96828e8ec02b4abe91b7c6328a84d114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.346635 17230 tablet_service.cc:1467] Processing CreateTablet for tablet db3516ecd8394495878d2f749d8fa27d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260929 11:36:39.426106 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:39.426515 17230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db3516ecd8394495878d2f749d8fa27d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:36:39.427536 17429 leader_election.cc:341] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.436388 17512 consensus_queue.cc:260] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:39.439043 17512 ts_tablet_manager.cc:1428] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.251s user 0.006s sys 0.000s
W20260929 11:36:39.439666 17356 leader_election.cc:341] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.440161 17356 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:39.447587 17451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119bbba610844188b3191eb62136fae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.451972 17518 raft_consensus.cc:2726] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:39.455006 17512 tablet_bootstrap.cc:492] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:39.460508 17513 raft_consensus.cc:348] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:39.469079 17528 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:39.474938 17528 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.475857 17453 tablet_service.cc:1467] Processing CreateTablet for tablet 5cfcf62331b042cb8ddc12c582c2d62c (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260929 11:36:39.476539 17228 tablet_service.cc:1467] Processing CreateTablet for tablet 35275d14d1b4485fbb03887df828daa2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260929 11:36:39.477622 17528 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:39.470393 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:39.477375 17229 tablet_service.cc:1467] Processing CreateTablet for tablet a1525efb73cb41699f311d353ec85272 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260929 11:36:39.480010 17513 raft_consensus.cc:374] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:39.482570 17513 raft_consensus.cc:729] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:39.484046 17228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35275d14d1b4485fbb03887df828daa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.497624 17519 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:39.498220 17519 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:39.489899 17431 leader_election.cc:341] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.499363 17431 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:39.513513 17225 tablet_service.cc:1467] Processing CreateTablet for tablet 0600a8955396487994f093e8edbd8ac0 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260929 11:36:39.523542 17515 tablet_bootstrap.cc:492] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:39.524272 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:39.524607 17374 tablet_service.cc:1467] Processing CreateTablet for tablet 119bbba610844188b3191eb62136fae2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260929 11:36:39.525928 17374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119bbba610844188b3191eb62136fae2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:36:39.525864 17429 leader_election.cc:341] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.524135 17515 ts_tablet_manager.cc:1397] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.485s user 0.021s sys 0.023s
I20260929 11:36:39.508101 17453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cfcf62331b042cb8ddc12c582c2d62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.490677 17513 consensus_queue.cc:260] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:39.543655 17376 tablet_service.cc:1467] Processing CreateTablet for tablet 930114cd75514fedbbd5bdfe525080f4 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260929 11:36:39.544863 17513 ts_tablet_manager.cc:1428] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.234s user 0.004s sys 0.005s
I20260929 11:36:39.544579 17455 tablet_service.cc:1467] Processing CreateTablet for tablet fdcbe5836ce94afda8b5e9d3a662ca76 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260929 11:36:39.545083 17376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930114cd75514fedbbd5bdfe525080f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.550618 17317 raft_consensus.cc:2454] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:39.552380 17522 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:39.553011 17522 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:39.541744 17229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1525efb73cb41699f311d353ec85272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.568286 17355 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:39.569978 17518 raft_consensus.cc:2781] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:39.581514 17225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0600a8955396487994f093e8edbd8ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.574369 17227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47666 (request call id 24) took 1112 ms. Trace:
I20260929 11:36:39.573804 17519 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:39.602913 17519 raft_consensus.cc:2726] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:39.589095 17511 tablet_bootstrap.cc:492] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:39.598258 17378 tablet_service.cc:1467] Processing CreateTablet for tablet 5cfcf62331b042cb8ddc12c582c2d62c (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260929 11:36:39.608915 17511 ts_tablet_manager.cc:1397] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.519s user 0.016s sys 0.012s
I20260929 11:36:39.613456 17378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cfcf62331b042cb8ddc12c582c2d62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.613586 17308 tablet_service.cc:1467] Processing CreateTablet for tablet ef0ba93c758b44c68b9eebc4712f42cd (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260929 11:36:39.615006 17308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef0ba93c758b44c68b9eebc4712f42cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.611802 17511 raft_consensus.cc:348] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.618944 17511 raft_consensus.cc:374] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:39.619277 17511 raft_consensus.cc:729] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:39.622519 17379 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac14169d0374d3ea61e619a1488a6f7 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260929 11:36:39.623935 17379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ac14169d0374d3ea61e619a1488a6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.625372 17375 tablet_service.cc:1467] Processing CreateTablet for tablet 75a68f6896d44d2ca026dcb8e903d1c9 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260929 11:36:39.626675 17375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a68f6896d44d2ca026dcb8e903d1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.585748 17449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7466b008788c41588274cefe10e78185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.585041 17513 tablet_bootstrap.cc:492] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:39.644536 17522 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:39.644811 17299 tablet_service.cc:1467] Processing CreateTablet for tablet ece37243cd8c44acaf6b92a5deb1274d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260929 11:36:39.653069 17226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47666 (request call id 27) took 1031 ms. Trace:
I20260929 11:36:39.653534 17226 rpcz_store.cc:276] 0929 11:36:38.621785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:39.119229 (+497444us) service_pool.cc:227] Handling call
0929 11:36:39.120997 (+ 1768us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:36:39.121091 (+ 94us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:36:39.379442 (+258351us) tablet_metadata.cc:641] Metadata flushed
0929 11:36:39.636576 (+257134us) tablet_replica.cc:205] Creating consensus instance
0929 11:36:39.653004 (+ 16428us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:39.654309 17232 tablet_service.cc:1467] Processing CreateTablet for tablet 119bbba610844188b3191eb62136fae2 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260929 11:36:39.654502 17515 raft_consensus.cc:348] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.655345 17515 raft_consensus.cc:374] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:39.621438 17511 consensus_queue.cc:260] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.672290 17232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119bbba610844188b3191eb62136fae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.586709 17227 rpcz_store.cc:276] 0929 11:36:38.461336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:39.000614 (+539278us) service_pool.cc:227] Handling call
0929 11:36:39.002342 (+ 1728us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:36:39.002493 (+ 151us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:36:39.301056 (+298563us) tablet_metadata.cc:641] Metadata flushed
0929 11:36:39.518894 (+217838us) tablet_replica.cc:205] Creating consensus instance
0929 11:36:39.573301 (+ 54407us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:39.673296 17301 tablet_service.cc:1467] Processing CreateTablet for tablet 7466b008788c41588274cefe10e78185 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260929 11:36:39.673584 17452 tablet_service.cc:1467] Processing CreateTablet for tablet 75a68f6896d44d2ca026dcb8e903d1c9 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260929 11:36:39.672290 17299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ece37243cd8c44acaf6b92a5deb1274d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.674697 17227 tablet_service.cc:1467] Processing CreateTablet for tablet 7466b008788c41588274cefe10e78185 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260929 11:36:39.673349 17455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdcbe5836ce94afda8b5e9d3a662ca76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.656361 17518 raft_consensus.cc:686] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:39.632994 17373 tablet_service.cc:1467] Processing CreateTablet for tablet 96828e8ec02b4abe91b7c6328a84d114 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260929 11:36:39.683334 17373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96828e8ec02b4abe91b7c6328a84d114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.687177 17301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7466b008788c41588274cefe10e78185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.687713 17518 consensus_queue.cc:237] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.668936 17515 raft_consensus.cc:729] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:39.691612 17515 consensus_queue.cc:260] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.692482 17452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a68f6896d44d2ca026dcb8e903d1c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:36:39.694715 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 204967us
I20260929 11:36:39.696795 17513 tablet_bootstrap.cc:654] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:39.709944 17302 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac14169d0374d3ea61e619a1488a6f7 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260929 11:36:39.733126 17302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ac14169d0374d3ea61e619a1488a6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.711992 17300 tablet_service.cc:1467] Processing CreateTablet for tablet fdcbe5836ce94afda8b5e9d3a662ca76 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260929 11:36:39.737223 17300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdcbe5836ce94afda8b5e9d3a662ca76. 1 dirs total, 0 dirs full, 0 dirs failed
W20260929 11:36:39.720853 17126 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 48622.9us
I20260929 11:36:39.740813 17227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7466b008788c41588274cefe10e78185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.750078 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:39.766558 17140 catalog_manager.cc:5495] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } }
W20260929 11:36:39.768972 17206 leader_election.cc:341] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.770036 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:39.731989 17231 tablet_service.cc:1467] Processing CreateTablet for tablet 96828e8ec02b4abe91b7c6328a84d114 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260929 11:36:39.792428 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:39.793375 17392 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:39.796558 17208 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:39.797705 17528 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:39.798081 17528 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:39.798416 17528 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:39.809506 17226 tablet_service.cc:1467] Processing CreateTablet for tablet ece37243cd8c44acaf6b92a5deb1274d (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260929 11:36:39.816453 17515 ts_tablet_manager.cc:1428] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.277s user 0.008s sys 0.000s
I20260929 11:36:39.817675 17515 tablet_bootstrap.cc:492] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:39.828116 17512 tablet_bootstrap.cc:654] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:39.844465 17231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96828e8ec02b4abe91b7c6328a84d114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.860100 17226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ece37243cd8c44acaf6b92a5deb1274d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.862619 17233 tablet_service.cc:1467] Processing CreateTablet for tablet 75a68f6896d44d2ca026dcb8e903d1c9 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260929 11:36:39.863936 17233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a68f6896d44d2ca026dcb8e903d1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.843899 17528 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:39.874445 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:39.875945 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:39.876740 17230 tablet_service.cc:1467] Processing CreateTablet for tablet fdcbe5836ce94afda8b5e9d3a662ca76 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260929 11:36:39.878851 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:39.879115 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:39.879745 17392 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:39.879145 17283 leader_election.cc:341] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:39.880234 17206 leader_election.cc:341] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.880661 17283 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:39.881173 17230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdcbe5836ce94afda8b5e9d3a662ca76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.881750 17522 raft_consensus.cc:2726] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:39.882750 17528 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:39.883103 17283 leader_election.cc:341] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.884940 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:39.922019 17282 leader_election.cc:341] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.922524 17282 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:39.923869 17522 raft_consensus.cc:2726] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:39.889770 17511 ts_tablet_manager.cc:1428] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.280s user 0.010s sys 0.013s
I20260929 11:36:39.925334 17511 tablet_bootstrap.cc:492] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:39.931280 17511 tablet_bootstrap.cc:654] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:39.892515 17515 tablet_bootstrap.cc:654] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:39.893050 17304 tablet_service.cc:1467] Processing CreateTablet for tablet 5cfcf62331b042cb8ddc12c582c2d62c (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260929 11:36:39.892534 17224 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac14169d0374d3ea61e619a1488a6f7 (DEFAULT_TABLE table=test-workload [id=c33ffac36bf0417991992a55b9f6afb6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260929 11:36:39.935621 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cfcf62331b042cb8ddc12c582c2d62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.902537 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:39.937783 17431 leader_election.cc:341] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:39.936057 17224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ac14169d0374d3ea61e619a1488a6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260929 11:36:39.939884 17431 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:39.945258 17544 raft_consensus.cc:2726] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:39.941279 17392 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:39.961686 17208 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:39.962983 17528 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:39.971459 17512 tablet_bootstrap.cc:492] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:39.972025 17512 ts_tablet_manager.cc:1397] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.525s user 0.042s sys 0.021s
I20260929 11:36:39.976862 17512 raft_consensus.cc:348] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:39.977627 17512 raft_consensus.cc:374] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:39.977932 17512 raft_consensus.cc:729] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:39.978659 17512 consensus_queue.cc:260] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:39.990196 17513 tablet_bootstrap.cc:492] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:39.990371 17512 ts_tablet_manager.cc:1428] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.018s user 0.004s sys 0.004s
I20260929 11:36:39.990906 17513 ts_tablet_manager.cc:1397] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.413s user 0.026s sys 0.011s
I20260929 11:36:39.991559 17512 tablet_bootstrap.cc:492] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:39.995584 17513 raft_consensus.cc:348] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.003865 17513 raft_consensus.cc:374] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.004221 17513 raft_consensus.cc:729] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.004951 17528 raft_consensus.cc:686] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:40.006515 17511 tablet_bootstrap.cc:492] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:40.006111 17528 consensus_queue.cc:237] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.007021 17511 ts_tablet_manager.cc:1397] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.082s user 0.011s sys 0.004s
I20260929 11:36:40.007570 17515 tablet_bootstrap.cc:492] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.008093 17515 ts_tablet_manager.cc:1397] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.191s user 0.017s sys 0.013s
I20260929 11:36:40.009902 17511 raft_consensus.cc:348] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.010768 17511 raft_consensus.cc:374] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.011150 17511 raft_consensus.cc:729] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.011008 17515 raft_consensus.cc:348] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.011950 17515 raft_consensus.cc:374] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.015156 17554 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.015764 17554 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.013026 17515 raft_consensus.cc:729] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.012283 17511 consensus_queue.cc:260] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.024998 17515 consensus_queue.cc:260] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.030161 17515 ts_tablet_manager.cc:1428] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.022s user 0.005s sys 0.001s
I20260929 11:36:40.031548 17515 tablet_bootstrap.cc:492] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:40.033325 17554 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:40.034010 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:40.035714 17206 leader_election.cc:341] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.033901 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:40.037809 17208 leader_election.cc:341] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.038386 17208 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:40.039903 17554 raft_consensus.cc:2726] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.041245 17512 tablet_bootstrap.cc:654] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.016878 17513 consensus_queue.cc:260] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.053951 17513 ts_tablet_manager.cc:1428] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.062s user 0.007s sys 0.000s
I20260929 11:36:40.055397 17513 tablet_bootstrap.cc:492] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.049628 17511 ts_tablet_manager.cc:1428] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.042s user 0.006s sys 0.003s
I20260929 11:36:40.060141 17511 tablet_bootstrap.cc:492] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:40.060313 17512 tablet_bootstrap.cc:492] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.060921 17512 ts_tablet_manager.cc:1397] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.070s user 0.013s sys 0.000s
I20260929 11:36:40.062644 17513 tablet_bootstrap.cc:654] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.063793 17512 raft_consensus.cc:348] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.064723 17512 raft_consensus.cc:374] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.065013 17512 raft_consensus.cc:729] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.066371 17512 consensus_queue.cc:260] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.067957 17515 tablet_bootstrap.cc:654] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.069859 17512 ts_tablet_manager.cc:1428] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260929 11:36:40.072781 17511 tablet_bootstrap.cc:654] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.072889 17512 tablet_bootstrap.cc:492] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.089103 17511 tablet_bootstrap.cc:492] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:40.089710 17511 ts_tablet_manager.cc:1397] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.004s
I20260929 11:36:40.091380 17528 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.092059 17528 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.092706 17511 raft_consensus.cc:348] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.093654 17511 raft_consensus.cc:374] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.093974 17511 raft_consensus.cc:729] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.094129 17528 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:40.094705 17141 catalog_manager.cc:5495] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:40.095150 17511 consensus_queue.cc:260] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.095789 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:40.097781 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:40.099754 17206 leader_election.cc:341] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:40.100783 17208 leader_election.cc:341] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.101370 17208 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:40.102473 17511 ts_tablet_manager.cc:1428] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260929 11:36:40.102870 17528 raft_consensus.cc:2726] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.103523 17511 tablet_bootstrap.cc:492] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:40.113205 17515 tablet_bootstrap.cc:492] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.113772 17515 ts_tablet_manager.cc:1397] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.083s user 0.014s sys 0.011s
I20260929 11:36:40.114789 17512 tablet_bootstrap.cc:654] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.121462 17515 raft_consensus.cc:348] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.122316 17515 raft_consensus.cc:374] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.122617 17515 raft_consensus.cc:729] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.123389 17515 consensus_queue.cc:260] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.126032 17515 ts_tablet_manager.cc:1428] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.012s user 0.004s sys 0.003s
I20260929 11:36:40.126379 17512 tablet_bootstrap.cc:492] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.126940 17512 ts_tablet_manager.cc:1397] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.054s user 0.010s sys 0.006s
I20260929 11:36:40.127097 17515 tablet_bootstrap.cc:492] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:40.129727 17512 raft_consensus.cc:348] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.130486 17512 raft_consensus.cc:374] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.130774 17512 raft_consensus.cc:729] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.132100 17512 consensus_queue.cc:260] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.133112 17513 tablet_bootstrap.cc:492] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:40.135924 17513 ts_tablet_manager.cc:1397] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.081s user 0.028s sys 0.015s
I20260929 11:36:40.136284 17511 tablet_bootstrap.cc:654] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.138693 17549 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.139225 17549 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.140185 17515 tablet_bootstrap.cc:654] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.134799 17512 ts_tablet_manager.cc:1428] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260929 11:36:40.141366 17549 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:40.143035 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.144236 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:40.145104 17356 leader_election.cc:341] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:40.145622 17357 leader_election.cc:341] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.146020 17357 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:40.146765 17549 raft_consensus.cc:2726] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.147748 17512 tablet_bootstrap.cc:492] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.150586 17513 raft_consensus.cc:348] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.151443 17513 raft_consensus.cc:374] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.151760 17513 raft_consensus.cc:729] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.152832 17513 consensus_queue.cc:260] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.155731 17512 tablet_bootstrap.cc:654] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.155781 17513 ts_tablet_manager.cc:1428] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20260929 11:36:40.156570 17515 tablet_bootstrap.cc:492] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.157081 17515 ts_tablet_manager.cc:1397] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.004s
I20260929 11:36:40.157191 17513 tablet_bootstrap.cc:492] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.161046 17515 raft_consensus.cc:348] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.163607 17511 tablet_bootstrap.cc:492] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:40.164304 17511 ts_tablet_manager.cc:1397] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.061s user 0.010s sys 0.010s
I20260929 11:36:40.165499 17513 tablet_bootstrap.cc:654] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.167127 17511 raft_consensus.cc:348] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.167977 17511 raft_consensus.cc:374] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.168962 17515 raft_consensus.cc:374] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.169065 17511 raft_consensus.cc:729] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.169356 17515 raft_consensus.cc:729] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.169828 17511 consensus_queue.cc:260] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.170007 17515 consensus_queue.cc:260] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.172119 17511 ts_tablet_manager.cc:1428] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260929 11:36:40.173768 17511 tablet_bootstrap.cc:492] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:40.172144 17515 ts_tablet_manager.cc:1428] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260929 11:36:40.176517 17515 tablet_bootstrap.cc:492] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:40.181200 17513 tablet_bootstrap.cc:492] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:40.181771 17513 ts_tablet_manager.cc:1397] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.000s
I20260929 11:36:40.184830 17513 raft_consensus.cc:348] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.185727 17513 raft_consensus.cc:374] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.186062 17513 raft_consensus.cc:729] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.186887 17513 consensus_queue.cc:260] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.187548 17515 tablet_bootstrap.cc:654] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.180249 17511 tablet_bootstrap.cc:654] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.189677 17513 ts_tablet_manager.cc:1428] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260929 11:36:40.178660 17512 tablet_bootstrap.cc:492] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.190948 17513 tablet_bootstrap.cc:492] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.191083 17512 ts_tablet_manager.cc:1397] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.044s user 0.015s sys 0.011s
I20260929 11:36:40.194060 17512 raft_consensus.cc:348] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.194854 17512 raft_consensus.cc:374] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.195156 17512 raft_consensus.cc:729] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.195829 17512 consensus_queue.cc:260] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.198218 17512 ts_tablet_manager.cc:1428] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260929 11:36:40.202472 17513 tablet_bootstrap.cc:654] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.210168 17512 tablet_bootstrap.cc:492] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.210997 17515 tablet_bootstrap.cc:492] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.211594 17515 ts_tablet_manager.cc:1397] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.035s user 0.021s sys 0.006s
I20260929 11:36:40.214464 17515 raft_consensus.cc:348] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.215376 17515 raft_consensus.cc:374] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.215732 17515 raft_consensus.cc:729] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.216411 17512 tablet_bootstrap.cc:654] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.216596 17515 consensus_queue.cc:260] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.221730 17511 tablet_bootstrap.cc:492] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:40.222165 17513 tablet_bootstrap.cc:492] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:40.222313 17511 ts_tablet_manager.cc:1397] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.004s
I20260929 11:36:40.222934 17513 ts_tablet_manager.cc:1397] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.002s
I20260929 11:36:40.225441 17511 raft_consensus.cc:348] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.226332 17511 raft_consensus.cc:374] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.226660 17511 raft_consensus.cc:729] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.227005 17513 raft_consensus.cc:348] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.227429 17511 consensus_queue.cc:260] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.227818 17513 raft_consensus.cc:374] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.228145 17513 raft_consensus.cc:729] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.228765 17515 ts_tablet_manager.cc:1428] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.017s user 0.006s sys 0.001s
I20260929 11:36:40.229113 17512 tablet_bootstrap.cc:492] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.229507 17511 ts_tablet_manager.cc:1428] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260929 11:36:40.229617 17512 ts_tablet_manager.cc:1397] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.008s
I20260929 11:36:40.230274 17513 consensus_queue.cc:260] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.233127 17513 ts_tablet_manager.cc:1428] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260929 11:36:40.229809 17515 tablet_bootstrap.cc:492] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:40.234105 17513 tablet_bootstrap.cc:492] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.239624 17515 tablet_bootstrap.cc:654] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.232777 17512 raft_consensus.cc:348] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.240453 17512 raft_consensus.cc:374] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.240623 17513 tablet_bootstrap.cc:654] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.240916 17512 raft_consensus.cc:729] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.241806 17512 consensus_queue.cc:260] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.244695 17512 ts_tablet_manager.cc:1428] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260929 11:36:40.249783 17512 tablet_bootstrap.cc:492] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.249841 17242 raft_consensus.cc:3037] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.252303 17511 tablet_bootstrap.cc:492] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:40.259176 17512 tablet_bootstrap.cc:654] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.264453 17549 consensus_queue.cc:1035] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:40.265470 17522 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.265864 17511 tablet_bootstrap.cc:654] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.265985 17522 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.268630 17522 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:40.271385 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.272579 17392 raft_consensus.cc:2379] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:40.274112 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:40.275564 17549 consensus_queue.cc:1035] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:40.279090 17283 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:40.280879 17522 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.293424 17522 raft_consensus.cc:2726] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.297969 17511 tablet_bootstrap.cc:492] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:40.298235 17513 tablet_bootstrap.cc:492] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:40.298560 17511 ts_tablet_manager.cc:1397] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.005s
I20260929 11:36:40.301679 17511 raft_consensus.cc:348] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.313460 17511 raft_consensus.cc:374] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.313828 17511 raft_consensus.cc:729] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.315538 17511 consensus_queue.cc:260] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.322790 17513 ts_tablet_manager.cc:1397] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.089s user 0.011s sys 0.009s
I20260929 11:36:40.325577 17511 ts_tablet_manager.cc:1428] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.027s user 0.009s sys 0.002s
I20260929 11:36:40.326740 17513 raft_consensus.cc:348] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.327862 17513 raft_consensus.cc:374] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.328235 17513 raft_consensus.cc:729] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.332650 17515 tablet_bootstrap.cc:492] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.332062 17513 consensus_queue.cc:260] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.333210 17515 ts_tablet_manager.cc:1397] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.104s user 0.004s sys 0.012s
I20260929 11:36:40.334919 17513 ts_tablet_manager.cc:1428] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260929 11:36:40.336153 17544 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.335996 17515 raft_consensus.cc:348] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.336828 17515 raft_consensus.cc:374] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.336673 17544 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.337163 17515 raft_consensus.cc:729] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.338179 17515 consensus_queue.cc:260] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.338740 17544 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:40.340478 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.341153 17392 raft_consensus.cc:2454] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:40.342307 17431 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:40.342867 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:40.343166 17544 raft_consensus.cc:2781] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.343528 17544 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.343858 17544 raft_consensus.cc:3037] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.347324 17511 tablet_bootstrap.cc:492] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
W20260929 11:36:40.348137 17431 leader_election.cc:341] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.335958 17513 tablet_bootstrap.cc:492] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.360493 17515 ts_tablet_manager.cc:1428] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20260929 11:36:40.362408 17522 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.366930 17585 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.368652 17522 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.369468 17515 tablet_bootstrap.cc:492] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:40.370728 17522 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:40.371733 17511 tablet_bootstrap.cc:654] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.375092 17512 tablet_bootstrap.cc:492] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.376443 17512 ts_tablet_manager.cc:1397] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.126s user 0.036s sys 0.037s
I20260929 11:36:40.379027 17512 raft_consensus.cc:348] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.379729 17512 raft_consensus.cc:374] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.379575 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.380048 17512 raft_consensus.cc:729] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.380724 17512 consensus_queue.cc:260] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.375315 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:40.383163 17283 leader_election.cc:341] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.380307 17466 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:40.372531 17585 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.385478 17282 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:40.386209 17585 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:40.388387 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:40.388787 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:40.389106 17242 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:40.389765 17318 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:40.390543 17431 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
W20260929 11:36:40.393507 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:40.393947 17585 raft_consensus.cc:2781] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.394342 17585 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.394701 17585 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.396442 17522 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.396847 17522 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.397230 17522 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.401714 17544 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.413751 17549 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.415759 17549 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.417927 17512 ts_tablet_manager.cc:1428] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.041s user 0.026s sys 0.012s
I20260929 11:36:40.418957 17549 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:40.420223 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:40.420354 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:40.420879 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.421571 17466 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
W20260929 11:36:40.421743 17357 leader_election.cc:341] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.423139 17356 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:40.414647 17513 tablet_bootstrap.cc:654] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.424692 17512 tablet_bootstrap.cc:492] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.421041 17392 raft_consensus.cc:3037] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.432411 17544 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:40.428663 17522 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.433017 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:40.434278 17522 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:40.434444 17431 leader_election.cc:341] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.437129 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:40.428133 17549 raft_consensus.cc:2781] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.438047 17512 tablet_bootstrap.cc:654] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.437806 17466 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.437120 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:40.438208 17549 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.439158 17549 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:40.439905 17283 leader_election.cc:341] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.446379 17528 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.447091 17528 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.452181 17513 tablet_bootstrap.cc:492] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:40.452786 17513 ts_tablet_manager.cc:1397] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.117s user 0.009s sys 0.007s
I20260929 11:36:40.455488 17528 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:40.455256 17513 raft_consensus.cc:348] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.456084 17513 raft_consensus.cc:374] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.456410 17513 raft_consensus.cc:729] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.457368 17513 consensus_queue.cc:260] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.459321 17466 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:40.460582 17282 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:40.460014 17528 consensus_queue.cc:1035] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:40.461861 17588 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.461684 17582 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.463191 17513 ts_tablet_manager.cc:1428] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.010s user 0.003s sys 0.004s
I20260929 11:36:40.465062 17513 tablet_bootstrap.cc:492] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.463682 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:40.466660 17582 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:40.467942 17206 leader_election.cc:341] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.467882 17392 raft_consensus.cc:2454] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:40.468758 17582 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:40.470096 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:40.474787 17242 raft_consensus.cc:2454] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:40.476573 17357 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:40.478309 17582 raft_consensus.cc:2781] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.478719 17582 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.479079 17582 raft_consensus.cc:3037] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.470232 17588 raft_consensus.cc:686] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:40.492682 17588 consensus_queue.cc:237] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.490796 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:40.498879 17582 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.500944 17585 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.502539 17585 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:40.503085 17512 tablet_bootstrap.cc:492] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.500368 17317 raft_consensus.cc:2454] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:40.503588 17512 ts_tablet_manager.cc:1397] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.079s user 0.011s sys 0.006s
I20260929 11:36:40.503917 17515 tablet_bootstrap.cc:654] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.503670 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:40.504531 17318 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.507066 17512 raft_consensus.cc:348] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.507954 17512 raft_consensus.cc:374] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.508234 17512 raft_consensus.cc:729] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.494051 17431 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:40.509002 17585 raft_consensus.cc:2781] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.508903 17512 consensus_queue.cc:260] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.509775 17585 raft_consensus.cc:686] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:40.510613 17585 consensus_queue.cc:237] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.511829 17512 ts_tablet_manager.cc:1428] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260929 11:36:40.512785 17512 tablet_bootstrap.cc:492] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.514905 17549 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.515367 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:40.515971 17242 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.517200 17318 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:40.518023 17512 tablet_bootstrap.cc:654] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.518450 17429 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:40.519452 17587 raft_consensus.cc:2781] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.520704 17587 raft_consensus.cc:686] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:40.521553 17587 consensus_queue.cc:237] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.523653 17513 tablet_bootstrap.cc:654] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.524286 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:40.524286 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:40.525015 17466 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:40.525902 17357 leader_election.cc:341] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.529140 17242 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:40.532006 17549 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:40.534123 17466 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:40.535629 17555 consensus_queue.cc:1035] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:40.543092 17582 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:40.544637 17511 tablet_bootstrap.cc:492] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:40.545557 17511 ts_tablet_manager.cc:1397] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.198s user 0.011s sys 0.011s
I20260929 11:36:40.546484 17356 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:40.546947 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:40.547621 17317 raft_consensus.cc:3037] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.548017 17585 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.550726 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:40.553862 17585 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.554725 17242 raft_consensus.cc:3037] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.549732 17522 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.558014 17522 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.560012 17522 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:40.570374 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:40.571350 17511 raft_consensus.cc:348] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.551591 17582 raft_consensus.cc:2781] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.572858 17582 raft_consensus.cc:686] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:40.573774 17582 consensus_queue.cc:237] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.577234 17141 catalog_manager.cc:5495] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 1 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:40.572131 17511 raft_consensus.cc:374] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.579761 17511 raft_consensus.cc:729] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.580837 17511 consensus_queue.cc:260] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.585309 17511 ts_tablet_manager.cc:1428] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.039s user 0.007s sys 0.000s
W20260929 11:36:40.581599 17431 leader_election.cc:341] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.596415 17587 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.609660 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:40.615365 17511 tablet_bootstrap.cc:492] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:40.616775 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.617540 17466 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:40.598235 17585 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:40.624107 17429 leader_election.cc:341] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.631718 17242 raft_consensus.cc:2454] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:40.621587 17587 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.626165 17429 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:40.637362 17599 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.637877 17599 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.637900 17585 raft_consensus.cc:2726] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.636343 17207 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:40.641376 17555 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.641822 17555 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.658574 17555 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.659018 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.659729 17392 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:40.661976 17512 tablet_bootstrap.cc:492] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.662500 17512 ts_tablet_manager.cc:1397] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.150s user 0.012s sys 0.035s
I20260929 11:36:40.662819 17544 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.663340 17544 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.663688 17317 raft_consensus.cc:2454] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:40.665357 17544 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:40.666002 17357 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:40.667285 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:40.668756 17431 leader_election.cc:341] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.669106 17528 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.668917 17515 tablet_bootstrap.cc:492] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.669827 17599 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:40.669688 17528 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.670365 17599 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.670843 17599 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.665047 17512 raft_consensus.cc:348] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.672533 17512 raft_consensus.cc:374] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.672912 17512 raft_consensus.cc:729] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.673731 17512 consensus_queue.cc:260] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.674798 17511 tablet_bootstrap.cc:654] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.674799 17515 ts_tablet_manager.cc:1397] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.306s user 0.013s sys 0.008s
I20260929 11:36:40.671953 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:40.675791 17528 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:40.680305 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.680437 17243 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
W20260929 11:36:40.682181 17282 leader_election.cc:341] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.676858 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.677901 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:40.677520 17138 catalog_manager.cc:5495] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:40.676502 17283 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:40.677515 17587 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:40.683290 17466 raft_consensus.cc:2454] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:40.684898 17515 raft_consensus.cc:348] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.685999 17512 ts_tablet_manager.cc:1428] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20260929 11:36:40.688227 17512 tablet_bootstrap.cc:492] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.687350 17515 raft_consensus.cc:374] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.688714 17515 raft_consensus.cc:729] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.689344 17515 consensus_queue.cc:260] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.685642 17513 tablet_bootstrap.cc:492] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:40.690667 17513 ts_tablet_manager.cc:1397] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.226s user 0.012s sys 0.015s
I20260929 11:36:40.682739 17582 raft_consensus.cc:2781] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.687633 17522 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.697690 17522 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.696978 17140 catalog_manager.cc:5495] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:40.698156 17512 tablet_bootstrap.cc:654] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.698137 17522 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.699071 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.699730 17391 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:40.700527 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.701231 17390 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:40.701781 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.702441 17466 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:40.704530 17207 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:40.705469 17528 raft_consensus.cc:2781] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.705827 17528 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.706235 17528 raft_consensus.cc:3037] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.707490 17513 raft_consensus.cc:348] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.705961 17522 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.694154 17515 ts_tablet_manager.cc:1428] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.018s user 0.004s sys 0.002s
I20260929 11:36:40.708207 17513 raft_consensus.cc:374] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.688755 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:40.687737 17599 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:40.709693 17515 tablet_bootstrap.cc:492] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:40.709941 17513 raft_consensus.cc:729] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.703914 17282 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:40.688022 17555 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.729508 17513 consensus_queue.cc:260] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.709661 17582 raft_consensus.cc:686] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:40.702454 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.732652 17513 ts_tablet_manager.cc:1428] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.042s user 0.004s sys 0.005s
W20260929 11:36:40.710300 17431 leader_election.cc:341] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.735379 17513 tablet_bootstrap.cc:492] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.712095 17317 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:40.717132 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.740852 17582 consensus_queue.cc:237] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:40.723448 17283 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:40.739089 17588 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.748651 17515 tablet_bootstrap.cc:654] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:40.745217 17208 leader_election.cc:341] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.749112 17429 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:40.750079 17585 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.739446 17390 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:40.752566 17585 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.752920 17588 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.753060 17585 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.753350 17588 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.736938 17431 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:40.754431 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:40.754763 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 45349.4us
I20260929 11:36:40.756065 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:40.756649 17466 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.752431 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:40.759034 17242 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.760562 17587 raft_consensus.cc:2726] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.763996 17466 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:40.750284 17599 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:40.766980 17599 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:40.767324 17599 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:40.756670 17206 leader_election.cc:341] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.772689 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:40.774703 17392 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.757890 17528 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.778033 17207 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:40.779230 17554 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.782927 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:40.749831 17522 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:40.784416 17208 leader_election.cc:341] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.751358 17555 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:40.791466 17512 tablet_bootstrap.cc:492] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.791985 17512 ts_tablet_manager.cc:1397] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.104s user 0.012s sys 0.000s
I20260929 11:36:40.794595 17512 raft_consensus.cc:348] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.795326 17512 raft_consensus.cc:374] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.795593 17512 raft_consensus.cc:729] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.796788 17528 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:40.798424 17511 tablet_bootstrap.cc:492] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:40.798197 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:40.798911 17511 ts_tablet_manager.cc:1397] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.184s user 0.006s sys 0.014s
I20260929 11:36:40.799202 17466 raft_consensus.cc:3037] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.796407 17588 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.803625 17588 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:40.804741 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:40.804642 17512 consensus_queue.cc:260] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.805142 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:40.805982 17390 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.806819 17512 ts_tablet_manager.cc:1428] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260929 11:36:40.807775 17512 tablet_bootstrap.cc:492] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.812279 17392 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:40.801627 17511 raft_consensus.cc:348] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.813513 17511 raft_consensus.cc:374] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.813436 17390 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:40.813867 17511 raft_consensus.cc:729] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.814011 17283 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:40.814555 17511 consensus_queue.cc:260] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.815116 17588 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.815652 17588 raft_consensus.cc:686] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:40.815807 17283 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:40.816615 17588 consensus_queue.cc:237] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.818080 17612 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.818625 17612 raft_consensus.cc:686] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:40.816629 17511 ts_tablet_manager.cc:1428] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20260929 11:36:40.821010 17511 tablet_bootstrap.cc:492] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:40.821453 17512 tablet_bootstrap.cc:654] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.822492 17242 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:40.828791 17528 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.820490 17585 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.819585 17612 consensus_queue.cc:237] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.829571 17528 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.830646 17465 raft_consensus.cc:2379] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:40.832341 17528 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:40.834745 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.835954 17390 raft_consensus.cc:2379] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:40.835675 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:40.837556 17554 raft_consensus.cc:686] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:40.838771 17554 consensus_queue.cc:237] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.840658 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.844082 17511 tablet_bootstrap.cc:654] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.844839 17207 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:40.847074 17611 raft_consensus.cc:3037] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.848011 17585 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:40.849638 17513 tablet_bootstrap.cc:654] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.849874 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:40.850859 17390 raft_consensus.cc:2379] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:40.851666 17512 tablet_bootstrap.cc:492] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:40.852147 17512 ts_tablet_manager.cc:1397] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.045s user 0.024s sys 0.008s
I20260929 11:36:40.811563 17599 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.852548 17431 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:40.856218 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:40.857175 17390 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.867731 17511 tablet_bootstrap.cc:492] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:40.874290 17599 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:40.861758 17585 raft_consensus.cc:2726] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.878031 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:40.880635 17515 tablet_bootstrap.cc:492] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.881201 17515 ts_tablet_manager.cc:1397] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.172s user 0.035s sys 0.017s
I20260929 11:36:40.882465 17466 raft_consensus.cc:2454] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:40.884665 17207 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:40.885908 17528 raft_consensus.cc:2781] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.886394 17528 raft_consensus.cc:686] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:40.887234 17528 consensus_queue.cc:237] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:40.889155 17282 leader_election.cc:341] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:40.889863 17390 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:40.891088 17283 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:40.892283 17515 raft_consensus.cc:348] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.892189 17599 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:40.893404 17515 raft_consensus.cc:374] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.893797 17515 raft_consensus.cc:729] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.893678 17599 raft_consensus.cc:686] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:40.894981 17515 consensus_queue.cc:260] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.892118 17512 raft_consensus.cc:348] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.895339 17599 consensus_queue.cc:237] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.895963 17512 raft_consensus.cc:374] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.896396 17512 raft_consensus.cc:729] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.898909 17515 ts_tablet_manager.cc:1428] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.017s user 0.003s sys 0.004s
I20260929 11:36:40.899933 17515 tablet_bootstrap.cc:492] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:40.901104 17511 ts_tablet_manager.cc:1397] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.080s user 0.018s sys 0.012s
I20260929 11:36:40.897959 17512 consensus_queue.cc:260] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.903656 17512 ts_tablet_manager.cc:1428] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.051s user 0.006s sys 0.000s
I20260929 11:36:40.907920 17513 tablet_bootstrap.cc:492] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:40.911324 17554 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:40.904103 17611 raft_consensus.cc:2726] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.919050 17554 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:40.918292 17513 ts_tablet_manager.cc:1397] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.183s user 0.011s sys 0.017s
I20260929 11:36:40.921663 17554 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:40.906701 17515 tablet_bootstrap.cc:654] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.921996 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:40.925664 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:40.926851 17465 raft_consensus.cc:2379] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:40.927026 17513 raft_consensus.cc:348] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.927796 17513 raft_consensus.cc:374] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.928062 17513 raft_consensus.cc:729] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.903746 17511 raft_consensus.cc:348] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.928730 17511 raft_consensus.cc:374] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.929021 17511 raft_consensus.cc:729] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.929733 17511 consensus_queue.cc:260] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.929796 17207 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:40.931255 17554 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:40.937144 17515 tablet_bootstrap.cc:492] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.936061 17139 catalog_manager.cc:5495] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:40.937703 17515 ts_tablet_manager.cc:1397] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.038s user 0.011s sys 0.013s
I20260929 11:36:40.939333 17554 raft_consensus.cc:2726] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:40.939203 17140 catalog_manager.cc:5495] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:40.940812 17515 raft_consensus.cc:348] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.941612 17515 raft_consensus.cc:374] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.941874 17515 raft_consensus.cc:729] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.942072 17511 ts_tablet_manager.cc:1428] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.041s user 0.005s sys 0.001s
I20260929 11:36:40.918617 17512 tablet_bootstrap.cc:492] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:40.944227 17511 tablet_bootstrap.cc:492] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:40.942669 17513 consensus_queue.cc:260] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.946138 17513 ts_tablet_manager.cc:1428] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s
I20260929 11:36:40.947130 17513 tablet_bootstrap.cc:492] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.948191 17139 catalog_manager.cc:5495] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:40.949510 17512 tablet_bootstrap.cc:654] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.942574 17515 consensus_queue.cc:260] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.953378 17513 tablet_bootstrap.cc:654] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.954422 17515 ts_tablet_manager.cc:1428] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20260929 11:36:40.954173 17599 consensus_queue.cc:1035] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:40.955478 17515 tablet_bootstrap.cc:492] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:40.955502 17511 tablet_bootstrap.cc:654] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.965510 17513 tablet_bootstrap.cc:492] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:40.966166 17515 tablet_bootstrap.cc:654] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.970121 17513 ts_tablet_manager.cc:1397] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.007s
I20260929 11:36:40.972445 17585 consensus_queue.cc:1035] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:40.973029 17513 raft_consensus.cc:348] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.973735 17513 raft_consensus.cc:374] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.973989 17513 raft_consensus.cc:729] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.973933 17141 catalog_manager.cc:5495] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 1 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:40.974925 17513 consensus_queue.cc:260] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:40.977665 17513 ts_tablet_manager.cc:1428] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260929 11:36:40.978932 17513 tablet_bootstrap.cc:492] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:40.980191 17137 catalog_manager.cc:5495] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:40.987059 17513 tablet_bootstrap.cc:654] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:40.987556 17515 tablet_bootstrap.cc:492] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:40.988220 17515 ts_tablet_manager.cc:1397] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.033s user 0.014s sys 0.003s
I20260929 11:36:40.983000 17137 catalog_manager.cc:5495] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:40.990132 17137 catalog_manager.cc:5495] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:40.991657 17515 raft_consensus.cc:348] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:40.992532 17515 raft_consensus.cc:374] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:40.992851 17515 raft_consensus.cc:729] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:40.993713 17515 consensus_queue.cc:260] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:41.000064 17511 tablet_bootstrap.cc:492] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:41.001587 17585 consensus_queue.cc:1035] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:41.005625 17515 ts_tablet_manager.cc:1428] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.017s user 0.002s sys 0.003s
I20260929 11:36:40.993480 17512 tablet_bootstrap.cc:492] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:41.006520 17512 ts_tablet_manager.cc:1397] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.088s user 0.016s sys 0.001s
I20260929 11:36:41.006687 17515 tablet_bootstrap.cc:492] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:41.008622 17511 ts_tablet_manager.cc:1397] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.008s
I20260929 11:36:41.043967 17243 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.052062 17515 tablet_bootstrap.cc:654] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.060038 17599 consensus_queue.cc:1035] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:41.075230 17582 consensus_queue.cc:1035] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:41.015236 17512 raft_consensus.cc:348] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.081773 17512 raft_consensus.cc:374] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.082120 17512 raft_consensus.cc:729] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.083441 17511 raft_consensus.cc:348] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.084247 17511 raft_consensus.cc:374] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.085596 17511 raft_consensus.cc:729] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.086262 17511 consensus_queue.cc:260] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.082974 17512 consensus_queue.cc:260] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.092783 17512 ts_tablet_manager.cc:1428] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.086s user 0.007s sys 0.001s
I20260929 11:36:41.094755 17515 tablet_bootstrap.cc:492] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:41.095304 17515 ts_tablet_manager.cc:1397] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.089s user 0.006s sys 0.005s
I20260929 11:36:41.095538 17512 tablet_bootstrap.cc:492] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:41.097955 17515 raft_consensus.cc:348] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.098665 17515 raft_consensus.cc:374] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.098924 17515 raft_consensus.cc:729] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.101429 17513 tablet_bootstrap.cc:492] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:41.101923 17513 ts_tablet_manager.cc:1397] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.123s user 0.040s sys 0.052s
I20260929 11:36:41.104864 17512 tablet_bootstrap.cc:654] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.104753 17513 raft_consensus.cc:348] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.105734 17513 raft_consensus.cc:374] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.106101 17513 raft_consensus.cc:729] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.106935 17513 consensus_queue.cc:260] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.109131 17511 ts_tablet_manager.cc:1428] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.100s user 0.008s sys 0.000s
I20260929 11:36:41.110232 17511 tablet_bootstrap.cc:492] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:41.099502 17515 consensus_queue.cc:260] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.117204 17515 ts_tablet_manager.cc:1428] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.022s user 0.007s sys 0.001s
I20260929 11:36:41.118173 17515 tablet_bootstrap.cc:492] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:41.117982 17587 consensus_queue.cc:1035] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:41.115041 17582 consensus_queue.cc:1035] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:41.124832 17513 ts_tablet_manager.cc:1428] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260929 11:36:41.125500 17599 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.125950 17599 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:41.127658 17599 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:41.128515 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:41.129231 17465 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:41.130573 17513 tablet_bootstrap.cc:492] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:41.134660 17512 tablet_bootstrap.cc:492] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:41.135277 17512 ts_tablet_manager.cc:1397] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.012s
I20260929 11:36:41.136276 17513 tablet_bootstrap.cc:654] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.138777 17282 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:41.144793 17582 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.145290 17511 tablet_bootstrap.cc:654] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.145313 17612 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.146078 17612 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:41.147099 17512 raft_consensus.cc:348] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.147806 17512 raft_consensus.cc:374] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.148293 17599 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:41.148504 17515 tablet_bootstrap.cc:654] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.148746 17599 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:41.149114 17599 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.148077 17512 raft_consensus.cc:729] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.151190 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.151388 17512 consensus_queue.cc:260] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.154973 17587 consensus_queue.cc:1035] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:41.156471 17512 ts_tablet_manager.cc:1428] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.021s user 0.009s sys 0.000s
I20260929 11:36:41.148038 17612 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:41.156554 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:41.158103 17465 raft_consensus.cc:2379] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:41.158331 17512 tablet_bootstrap.cc:492] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:41.161720 17582 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.162115 17282 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:41.164776 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:41.165479 17612 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:41.166179 17355 leader_election.cc:341] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.166487 17512 tablet_bootstrap.cc:654] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.174072 17637 consensus_queue.cc:1035] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:41.136652 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.186203 17243 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:41.189076 17587 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.189776 17587 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.191928 17612 raft_consensus.cc:2726] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:41.192677 17599 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:41.193213 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:41.193428 17587 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:41.194469 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:41.195173 17390 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
W20260929 11:36:41.195377 17429 leader_election.cc:341] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.196529 17431 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:41.196841 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:41.196988 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:41.197834 17465 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.197930 17587 raft_consensus.cc:2781] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:41.198499 17587 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:41.198801 17587 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.201472 17243 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.206097 17599 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:41.213776 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:41.218890 17243 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:41.218001 17549 consensus_queue.cc:1035] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260929 11:36:41.225158 17528 consensus_queue.cc:1035] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:41.225540 17637 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.226218 17637 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.214423 17582 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:41.230381 17465 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:41.239353 17282 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:41.232594 17585 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.240558 17599 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:41.241039 17599 raft_consensus.cc:686] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:41.241309 17512 tablet_bootstrap.cc:492] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:41.241777 17512 ts_tablet_manager.cc:1397] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.084s user 0.009s sys 0.004s
I20260929 11:36:41.241412 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:41.241863 17599 consensus_queue.cc:237] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:41.244413 17512 raft_consensus.cc:348] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:41.249075 17512 raft_consensus.cc:374] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.249425 17512 raft_consensus.cc:729] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.250181 17512 consensus_queue.cc:260] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:41.248631 17585 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:41.257064 17356 leader_election.cc:341] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.257385 17512 ts_tablet_manager.cc:1428] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.015s user 0.004s sys 0.004s
I20260929 11:36:41.257642 17585 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:41.258348 17512 tablet_bootstrap.cc:492] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:41.259652 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:41.230712 17637 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:41.260414 17316 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:41.243840 17582 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.262141 17582 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.264588 17512 tablet_bootstrap.cc:654] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.265005 17582 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:41.265826 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:41.266526 17465 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:41.279141 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.278378 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:41.286621 17355 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:41.279356 17356 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:41.296087 17515 tablet_bootstrap.cc:492] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:41.296828 17515 ts_tablet_manager.cc:1397] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.179s user 0.022s sys 0.018s
I20260929 11:36:41.289047 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:41.303179 17638 raft_consensus.cc:2781] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:41.303634 17638 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:41.303941 17638 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.301110 17317 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:41.307231 17599 consensus_queue.cc:1035] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:41.297219 17637 raft_consensus.cc:2781] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260929 11:36:41.301020 17431 leader_election.cc:341] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:41.312153 17429 leader_election.cc:341] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.310316 17637 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:41.324636 17513 tablet_bootstrap.cc:492] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:41.325358 17513 ts_tablet_manager.cc:1397] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.195s user 0.024s sys 0.030s
I20260929 11:36:41.322960 17637 raft_consensus.cc:3037] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.328691 17587 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.337415 17511 tablet_bootstrap.cc:492] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:41.338094 17511 ts_tablet_manager.cc:1397] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.228s user 0.023s sys 0.021s
I20260929 11:36:41.342374 17466 raft_consensus.cc:2379] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:41.345343 17429 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:41.341989 17544 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.346073 17544 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.346477 17599 consensus_queue.cc:1035] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:41.346927 17651 raft_consensus.cc:2726] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:41.347054 17463 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.349493 17515 raft_consensus.cc:348] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.350004 17515 raft_consensus.cc:374] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.350157 17515 raft_consensus.cc:729] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.350656 17515 consensus_queue.cc:260] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.348105 17544 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:41.351788 17645 log.cc:924] Time spent T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.055s user 0.000s sys 0.001s
I20260929 11:36:41.352749 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:41.346324 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 46044.7us
I20260929 11:36:41.353569 17392 raft_consensus.cc:2379] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:41.354813 17356 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:41.352222 17139 catalog_manager.cc:5495] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:41.359133 17515 ts_tablet_manager.cc:1428] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.062s user 0.005s sys 0.000s
I20260929 11:36:41.361557 17513 raft_consensus.cc:348] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.362166 17513 raft_consensus.cc:374] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.362397 17513 raft_consensus.cc:729] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.362890 17513 consensus_queue.cc:260] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.425778 17513 ts_tablet_manager.cc:1428] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.100s user 0.012s sys 0.029s
I20260929 11:36:41.427220 17511 raft_consensus.cc:348] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.428227 17511 raft_consensus.cc:374] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.428522 17511 raft_consensus.cc:729] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.429385 17511 consensus_queue.cc:260] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.433853 17512 tablet_bootstrap.cc:492] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:41.434554 17512 ts_tablet_manager.cc:1397] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.176s user 0.012s sys 0.001s
I20260929 11:36:41.436661 17588 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.437391 17587 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:41.437188 17588 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.442502 17588 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:41.472558 17511 ts_tablet_manager.cc:1428] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.134s user 0.009s sys 0.002s
W20260929 11:36:41.473203 17556 log.cc:924] Time spent T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf: Append to log took a long time: real 0.066s user 0.000s sys 0.006s
I20260929 11:36:41.473546 17511 tablet_bootstrap.cc:492] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
W20260929 11:36:41.465891 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 111173us
I20260929 11:36:41.474457 17513 tablet_bootstrap.cc:492] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:41.476941 17587 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.477582 17587 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.478673 17512 raft_consensus.cc:348] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.479408 17512 raft_consensus.cc:374] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.479610 17587 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:41.479722 17512 raft_consensus.cc:729] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
W20260929 11:36:41.481622 17648 log.cc:924] Time spent T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260929 11:36:41.482823 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:41.483858 17511 tablet_bootstrap.cc:654] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.486861 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:41.493674 17512 consensus_queue.cc:260] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.467175 17651 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.467378 17654 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.466142 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.498939 17512 ts_tablet_manager.cc:1428] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.064s user 0.007s sys 0.001s
I20260929 11:36:41.446882 17638 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.493461 17528 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.501332 17512 tablet_bootstrap.cc:492] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:41.476132 17637 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.523085 17513 tablet_bootstrap.cc:654] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.519089 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:41.502480 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 76694.9us
I20260929 11:36:41.531126 17585 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.535772 17638 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:41.536188 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:41.530158 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:41.538098 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:41.538967 17637 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:41.538851 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:41.502143 17599 consensus_queue.cc:1035] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260929 11:36:41.539417 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:41.539717 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:41.537344 17515 tablet_bootstrap.cc:492] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:41.508850 17528 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.568696 17313 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.569345 17528 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:36:41.531663 17283 leader_election.cc:341] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:41.571173 17283 leader_election.cc:341] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.571604 17283 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:41.551330 17654 raft_consensus.cc:2726] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:41.556275 17391 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:41.501003 17651 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:41.542634 17585 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.577494 17651 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:41.554359 17512 tablet_bootstrap.cc:654] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.578588 17585 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:41.556113 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:41.555061 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.534472 17554 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.566964 17463 raft_consensus.cc:3037] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.581605 17242 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:41.585573 17313 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:41.587145 17355 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:41.581609 17554 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.589712 17554 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:41.575214 17431 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:41.590509 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:41.591253 17391 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:41.591912 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:41.567416 17312 raft_consensus.cc:3037] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:41.596932 17431 leader_election.cc:341] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.597044 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.597393 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.587248 17390 raft_consensus.cc:3037] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:41.593101 17356 leader_election.cc:341] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.609891 17511 tablet_bootstrap.cc:492] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:41.589749 17637 raft_consensus.cc:2781] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:41.612504 17511 ts_tablet_manager.cc:1397] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.139s user 0.011s sys 0.014s
I20260929 11:36:41.614542 17661 raft_consensus.cc:2726] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:41.614653 17667 consensus_queue.cc:1035] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:41.606618 17585 raft_consensus.cc:2781] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:41.620906 17585 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:41.621310 17585 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.621935 17661 consensus_queue.cc:1035] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:41.621745 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:41.625002 17431 leader_election.cc:341] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.625636 17431 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:41.626567 17587 raft_consensus.cc:2726] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:36:41.627700 17431 leader_election.cc:341] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.630167 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:41.606678 17554 consensus_queue.cc:1035] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260929 11:36:41.638702 17515 tablet_bootstrap.cc:654] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.645715 17429 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:41.647493 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:41.636825 17637 raft_consensus.cc:686] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:41.650354 17392 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:41.658939 17208 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:41.664448 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:41.665375 17208 leader_election.cc:341] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:41.660861 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 46399.9us
I20260929 11:36:41.666414 17637 consensus_queue.cc:237] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.656834 17554 consensus_queue.cc:1035] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260929 11:36:41.654599 17463 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:41.670953 17312 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:41.672019 17355 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:41.673322 17654 raft_consensus.cc:2781] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:41.674141 17513 tablet_bootstrap.cc:492] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:41.674687 17513 ts_tablet_manager.cc:1397] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.200s user 0.008s sys 0.008s
I20260929 11:36:41.676880 17654 raft_consensus.cc:686] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
W20260929 11:36:41.681041 17429 leader_election.cc:341] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:41.681784 17429 leader_election.cc:341] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.682214 17429 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:41.681813 17654 consensus_queue.cc:237] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.682973 17544 raft_consensus.cc:2726] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:41.679829 17611 raft_consensus.cc:2781] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260929 11:36:41.689625 17206 leader_election.cc:341] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.696827 17206 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:41.691543 17661 consensus_queue.cc:1035] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:41.693316 17512 tablet_bootstrap.cc:492] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:41.699332 17512 ts_tablet_manager.cc:1397] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.198s user 0.016s sys 0.023s
I20260929 11:36:41.695407 17582 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.698381 17528 raft_consensus.cc:2726] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:41.702514 17582 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.696264 17611 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:41.708968 17513 raft_consensus.cc:348] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.711058 17513 raft_consensus.cc:374] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.711380 17513 raft_consensus.cc:729] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.713212 17513 consensus_queue.cc:260] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.716769 17511 raft_consensus.cc:348] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.717528 17511 raft_consensus.cc:374] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.717784 17511 raft_consensus.cc:729] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.718237 17585 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.718461 17511 consensus_queue.cc:260] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.719331 17663 consensus_queue.cc:1035] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260929 11:36:41.722499 17585 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:41.720662 17464 raft_consensus.cc:2379] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:41.721714 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:41.711259 17611 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.721942 17512 raft_consensus.cc:348] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.725647 17512 raft_consensus.cc:374] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.726004 17512 raft_consensus.cc:729] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.726703 17512 consensus_queue.cc:260] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.728642 17511 ts_tablet_manager.cc:1428] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.112s user 0.003s sys 0.004s
I20260929 11:36:41.724920 17513 ts_tablet_manager.cc:1428] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.050s user 0.007s sys 0.001s
I20260929 11:36:41.732250 17513 tablet_bootstrap.cc:492] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:41.728989 17512 ts_tablet_manager.cc:1428] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260929 11:36:41.734532 17512 tablet_bootstrap.cc:492] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:41.737165 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:41.729049 17390 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.760685 17512 tablet_bootstrap.cc:654] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.795193 17587 raft_consensus.cc:2726] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:41.769361 17431 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:41.824132 17515 tablet_bootstrap.cc:492] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:41.824694 17515 ts_tablet_manager.cc:1397] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.288s user 0.019s sys 0.015s
I20260929 11:36:41.825387 17585 raft_consensus.cc:2781] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:41.827896 17585 raft_consensus.cc:686] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:41.836938 17513 tablet_bootstrap.cc:654] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.841532 17390 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
W20260929 11:36:41.831630 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 66329.3us
I20260929 11:36:41.842061 17582 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:41.847896 17431 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:41.848621 17668 consensus_queue.cc:1035] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260929 11:36:41.849200 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:41.850567 17511 tablet_bootstrap.cc:492] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:41.859891 17661 consensus_queue.cc:1035] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:41.858075 17585 consensus_queue.cc:237] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.863289 17670 raft_consensus.cc:2781] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:41.869521 17670 raft_consensus.cc:686] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:41.870756 17511 tablet_bootstrap.cc:654] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.870452 17670 consensus_queue.cc:237] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.873160 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.878647 17357 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:41.880097 17637 raft_consensus.cc:2726] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:41.881846 17611 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.883414 17241 raft_consensus.cc:2379] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 1: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:41.888782 17515 raft_consensus.cc:348] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.889811 17515 raft_consensus.cc:374] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.890138 17515 raft_consensus.cc:729] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.890913 17515 consensus_queue.cc:260] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.901885 17672 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.902554 17672 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.905025 17672 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:41.905426 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:41.905817 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:41.906791 17429 leader_election.cc:341] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.906950 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:41.907814 17388 raft_consensus.cc:2379] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
W20260929 11:36:41.907759 17431 leader_election.cc:341] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.908444 17431 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:41.909623 17672 raft_consensus.cc:2726] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:41.912999 17611 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:41.916923 17515 ts_tablet_manager.cc:1428] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.092s user 0.004s sys 0.004s
I20260929 11:36:41.918190 17515 tablet_bootstrap.cc:492] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:41.928682 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:41.929419 17513 tablet_bootstrap.cc:492] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:41.930078 17513 ts_tablet_manager.cc:1397] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.198s user 0.011s sys 0.002s
I20260929 11:36:41.930893 17207 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:41.932570 17671 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.933151 17671 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.936861 17671 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:41.936782 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:41.937467 17671 raft_consensus.cc:2726] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260929 11:36:41.938264 17208 leader_election.cc:341] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.940191 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:41.944183 17465 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:41.941347 17513 raft_consensus.cc:348] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.946175 17513 raft_consensus.cc:374] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.946548 17513 raft_consensus.cc:729] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.944559 17512 tablet_bootstrap.cc:492] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:41.948022 17512 ts_tablet_manager.cc:1397] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.214s user 0.022s sys 0.015s
I20260929 11:36:41.947398 17513 consensus_queue.cc:260] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.950528 17512 raft_consensus.cc:348] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.951259 17512 raft_consensus.cc:374] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.952968 17515 tablet_bootstrap.cc:654] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.951509 17512 raft_consensus.cc:729] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:41.959851 17512 consensus_queue.cc:260] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:41.963976 17512 ts_tablet_manager.cc:1428] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260929 11:36:41.965299 17512 tablet_bootstrap.cc:492] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:41.975179 17207 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:41.976354 17611 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:41.976856 17611 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:41.977210 17611 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.977301 17137 catalog_manager.cc:5495] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:41.979198 17512 tablet_bootstrap.cc:654] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:41.950203 17513 ts_tablet_manager.cc:1428] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.020s user 0.008s sys 0.000s
I20260929 11:36:41.979491 17137 catalog_manager.cc:5495] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:41.985257 17512 tablet_bootstrap.cc:492] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:41.985812 17512 ts_tablet_manager.cc:1397] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.002s
I20260929 11:36:41.985896 17611 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.988307 17512 raft_consensus.cc:348] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.988694 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:41.989107 17512 raft_consensus.cc:374] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:41.989377 17512 raft_consensus.cc:729] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
W20260929 11:36:41.990085 17208 leader_election.cc:341] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.990727 17668 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:41.990085 17512 consensus_queue.cc:260] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:41.991365 17668 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:41.993680 17512 ts_tablet_manager.cc:1428] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260929 11:36:41.992082 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:41.994390 17465 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:41.994706 17512 tablet_bootstrap.cc:492] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:41.995242 17668 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:41.995913 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:41.996526 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:41.997210 17241 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
W20260929 11:36:41.997741 17283 leader_election.cc:341] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:41.985414 17513 tablet_bootstrap.cc:492] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:41.998510 17283 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:41.993777 17515 tablet_bootstrap.cc:492] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:42.000253 17668 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:42.000780 17512 tablet_bootstrap.cc:654] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.001169 17611 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:42.000674 17515 ts_tablet_manager.cc:1397] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.083s user 0.018s sys 0.011s
I20260929 11:36:42.000687 17668 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:42.003582 17668 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.004163 17515 raft_consensus.cc:348] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.004951 17515 raft_consensus.cc:374] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.005216 17515 raft_consensus.cc:729] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.005959 17515 consensus_queue.cc:260] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.006840 17511 tablet_bootstrap.cc:492] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:42.007375 17511 ts_tablet_manager.cc:1397] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.157s user 0.016s sys 0.021s
I20260929 11:36:42.008471 17465 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:42.009684 17207 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.010421 17668 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.011165 17611 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.011561 17513 tablet_bootstrap.cc:654] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.011824 17611 raft_consensus.cc:686] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:42.013182 17668 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:42.012948 17611 consensus_queue.cc:237] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.013345 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:42.014019 17241 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.015075 17511 raft_consensus.cc:348] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.016736 17511 raft_consensus.cc:374] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.017066 17511 raft_consensus.cc:729] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.017514 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:42.017798 17511 consensus_queue.cc:260] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.019085 17515 ts_tablet_manager.cc:1428] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.017s user 0.005s sys 0.001s
W20260929 11:36:42.019224 17283 leader_election.cc:341] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.020433 17515 tablet_bootstrap.cc:492] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:42.020195 17511 ts_tablet_manager.cc:1428] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260929 11:36:42.021890 17511 tablet_bootstrap.cc:492] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:42.025470 17241 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:42.027071 17283 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.027932 17668 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.028450 17668 raft_consensus.cc:686] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:42.029346 17668 consensus_queue.cc:237] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.032541 17511 tablet_bootstrap.cc:654] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.033499 17513 tablet_bootstrap.cc:492] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:42.033983 17513 ts_tablet_manager.cc:1397] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.049s user 0.011s sys 0.004s
I20260929 11:36:42.027104 17512 tablet_bootstrap.cc:492] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:42.035530 17512 ts_tablet_manager.cc:1397] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.041s user 0.009s sys 0.013s
I20260929 11:36:42.036477 17513 raft_consensus.cc:348] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.037216 17513 raft_consensus.cc:374] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.037470 17513 raft_consensus.cc:729] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.037930 17512 raft_consensus.cc:348] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.038092 17513 consensus_queue.cc:260] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.038653 17512 raft_consensus.cc:374] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.038946 17512 raft_consensus.cc:729] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.039820 17512 consensus_queue.cc:260] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.040558 17515 tablet_bootstrap.cc:654] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.041388 17585 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.041911 17585 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.043689 17513 ts_tablet_manager.cc:1428] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260929 11:36:42.044615 17513 tablet_bootstrap.cc:492] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:42.044771 17512 ts_tablet_manager.cc:1428] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260929 11:36:42.045610 17512 tablet_bootstrap.cc:492] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:42.045473 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.046663 17312 raft_consensus.cc:2379] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 1: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:42.051128 17513 tablet_bootstrap.cc:654] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.050921 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:42.051604 17512 tablet_bootstrap.cc:654] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.058131 17429 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.059799 17670 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.056815 17585 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:42.069020 17611 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.069579 17611 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.070163 17511 tablet_bootstrap.cc:492] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:42.070641 17511 ts_tablet_manager.cc:1397] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.011s
I20260929 11:36:42.071659 17611 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:42.073225 17511 raft_consensus.cc:348] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.073606 17670 raft_consensus.cc:2726] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.073951 17511 raft_consensus.cc:374] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.074282 17511 raft_consensus.cc:729] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.074836 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.075515 17312 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:42.075382 17511 consensus_queue.cc:260] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.076495 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:42.077859 17208 leader_election.cc:341] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.079137 17511 ts_tablet_manager.cc:1428] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260929 11:36:42.080181 17511 tablet_bootstrap.cc:492] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:42.080390 17206 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.081532 17588 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.082181 17588 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.084501 17588 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:42.085999 17611 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:42.085888 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.086494 17611 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:42.086910 17611 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.089463 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:42.090267 17388 raft_consensus.cc:2379] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:42.090648 17512 tablet_bootstrap.cc:492] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:42.091264 17283 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.092453 17588 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.093015 17670 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.093561 17670 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.095278 17582 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.095768 17582 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.096386 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:42.097821 17582 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.098016 17511 tablet_bootstrap.cc:654] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.099382 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:42.100033 17431 leader_election.cc:341] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.100140 17465 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:42.100790 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.101413 17356 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:42.102797 17637 raft_consensus.cc:2781] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260929 11:36:42.102913 17357 leader_election.cc:341] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.103197 17637 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:42.103559 17637 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.103878 17588 raft_consensus.cc:2726] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.105939 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.106717 17513 tablet_bootstrap.cc:492] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:42.107240 17513 ts_tablet_manager.cc:1397] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.063s user 0.011s sys 0.005s
W20260929 11:36:42.107329 17431 leader_election.cc:341] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.107765 17431 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.106228 17515 tablet_bootstrap.cc:492] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:42.108599 17515 ts_tablet_manager.cc:1397] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.088s user 0.009s sys 0.041s
I20260929 11:36:42.108644 17585 raft_consensus.cc:2726] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.109087 17670 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.110714 17141 catalog_manager.cc:5495] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 1 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:42.110387 17513 raft_consensus.cc:348] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.111864 17513 raft_consensus.cc:374] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.112129 17513 raft_consensus.cc:729] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.091290 17512 ts_tablet_manager.cc:1397] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.046s user 0.010s sys 0.004s
I20260929 11:36:42.112756 17513 consensus_queue.cc:260] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.113327 17515 raft_consensus.cc:348] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.113981 17515 raft_consensus.cc:374] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.114257 17515 raft_consensus.cc:729] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.114802 17513 ts_tablet_manager.cc:1428] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260929 11:36:42.114945 17515 consensus_queue.cc:260] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.115720 17513 tablet_bootstrap.cc:492] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:42.115442 17611 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.117190 17515 ts_tablet_manager.cc:1428] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260929 11:36:42.118098 17515 tablet_bootstrap.cc:492] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:42.117990 17512 raft_consensus.cc:348] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.118729 17512 raft_consensus.cc:374] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.118988 17512 raft_consensus.cc:729] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.120504 17582 consensus_queue.cc:1035] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:42.121425 17513 tablet_bootstrap.cc:654] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.121521 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:42.122187 17312 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.123688 17515 tablet_bootstrap.cc:654] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.124047 17141 catalog_manager.cc:5495] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 1 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:42.130913 17512 consensus_queue.cc:260] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.138267 17312 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:42.139087 17513 tablet_bootstrap.cc:492] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:42.139570 17513 ts_tablet_manager.cc:1397] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.014s
I20260929 11:36:42.139493 17206 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:42.141861 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:36:42.143235 17208 leader_election.cc:341] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.143652 17637 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.144016 17611 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:42.144986 17611 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.145705 17637 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.148378 17611 raft_consensus.cc:686] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:42.149662 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:42.150269 17464 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.150435 17611 consensus_queue.cc:237] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.149498 17512 ts_tablet_manager.cc:1428] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.036s user 0.005s sys 0.001s
I20260929 11:36:42.151829 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:42.152547 17513 raft_consensus.cc:348] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:42.153519 17357 leader_election.cc:341] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.153782 17513 raft_consensus.cc:374] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.154129 17513 raft_consensus.cc:729] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.154974 17513 consensus_queue.cc:260] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.156863 17513 ts_tablet_manager.cc:1428] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20260929 11:36:42.157899 17513 tablet_bootstrap.cc:492] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:42.153020 17512 tablet_bootstrap.cc:492] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:42.162709 17637 consensus_queue.cc:1035] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:42.173223 17513 tablet_bootstrap.cc:654] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.180613 17515 tablet_bootstrap.cc:492] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:42.181211 17512 tablet_bootstrap.cc:654] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.181298 17515 ts_tablet_manager.cc:1397] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.004s
I20260929 11:36:42.184864 17515 raft_consensus.cc:348] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.185588 17515 raft_consensus.cc:374] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.185850 17515 raft_consensus.cc:729] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.186553 17515 consensus_queue.cc:260] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.188822 17515 ts_tablet_manager.cc:1428] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260929 11:36:42.190022 17515 tablet_bootstrap.cc:492] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:42.165151 17637 consensus_queue.cc:1035] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260929 11:36:42.214195 17511 tablet_bootstrap.cc:492] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:42.214705 17511 ts_tablet_manager.cc:1397] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.135s user 0.006s sys 0.005s
I20260929 11:36:42.217237 17511 raft_consensus.cc:348] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.217976 17511 raft_consensus.cc:374] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.218207 17513 tablet_bootstrap.cc:492] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:42.218248 17511 raft_consensus.cc:729] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.218843 17513 ts_tablet_manager.cc:1397] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.003s
I20260929 11:36:42.219112 17511 consensus_queue.cc:260] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.219993 17515 tablet_bootstrap.cc:654] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.221226 17511 ts_tablet_manager.cc:1428] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260929 11:36:42.221318 17513 raft_consensus.cc:348] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.221976 17513 raft_consensus.cc:374] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.222249 17513 raft_consensus.cc:729] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.222877 17511 tablet_bootstrap.cc:492] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:42.222949 17512 tablet_bootstrap.cc:492] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:42.223762 17512 ts_tablet_manager.cc:1397] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.071s user 0.011s sys 0.015s
I20260929 11:36:42.226368 17512 raft_consensus.cc:348] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.227342 17512 raft_consensus.cc:374] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.227663 17512 raft_consensus.cc:729] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.228400 17512 consensus_queue.cc:260] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.229640 17511 tablet_bootstrap.cc:654] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.231879 17464 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:42.237994 17582 consensus_queue.cc:1035] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:42.239192 17139 catalog_manager.cc:5495] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:42.222846 17513 consensus_queue.cc:260] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.241775 17139 catalog_manager.cc:5495] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:42.242834 17513 ts_tablet_manager.cc:1428] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.024s user 0.004s sys 0.002s
I20260929 11:36:42.244793 17356 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:42.245252 17513 tablet_bootstrap.cc:492] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:42.245990 17637 raft_consensus.cc:2781] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.246531 17511 tablet_bootstrap.cc:492] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:42.246511 17637 raft_consensus.cc:686] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:42.247110 17511 ts_tablet_manager.cc:1397] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.003s
I20260929 11:36:42.247534 17637 consensus_queue.cc:237] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.249480 17511 raft_consensus.cc:348] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.250187 17511 raft_consensus.cc:374] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.250442 17511 raft_consensus.cc:729] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.251015 17511 consensus_queue.cc:260] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.253319 17511 ts_tablet_manager.cc:1428] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260929 11:36:42.254390 17511 tablet_bootstrap.cc:492] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:42.254586 17513 tablet_bootstrap.cc:654] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.260581 17511 tablet_bootstrap.cc:654] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.262524 17512 ts_tablet_manager.cc:1428] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.038s user 0.003s sys 0.003s
I20260929 11:36:42.263538 17512 tablet_bootstrap.cc:492] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:42.264624 17515 tablet_bootstrap.cc:492] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:42.265182 17515 ts_tablet_manager.cc:1397] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.075s user 0.014s sys 0.000s
I20260929 11:36:42.265334 17585 consensus_queue.cc:1035] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:42.267809 17515 raft_consensus.cc:348] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.272730 17515 raft_consensus.cc:374] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.273101 17515 raft_consensus.cc:729] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.274307 17515 consensus_queue.cc:260] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.282791 17137 catalog_manager.cc:5495] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:42.288584 17515 ts_tablet_manager.cc:1428] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260929 11:36:42.292892 17666 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.293370 17512 tablet_bootstrap.cc:654] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.294255 17585 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.293694 17666 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.294780 17585 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.296878 17585 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:42.298022 17666 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.298283 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.298782 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:42.299839 17283 leader_election.cc:341] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:42.300737 17431 leader_election.cc:341] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.300797 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.301681 17515 tablet_bootstrap.cc:492] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:42.302882 17511 tablet_bootstrap.cc:492] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:42.303385 17511 ts_tablet_manager.cc:1397] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.049s user 0.011s sys 0.005s
I20260929 11:36:42.304935 17513 tablet_bootstrap.cc:492] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
W20260929 11:36:42.304948 17429 leader_election.cc:341] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.311961 17513 ts_tablet_manager.cc:1397] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.067s user 0.013s sys 0.023s
I20260929 11:36:42.306740 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.312633 17465 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:42.313884 17282 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:42.311812 17429 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.315481 17513 raft_consensus.cc:348] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.316505 17585 raft_consensus.cc:2726] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.316670 17513 raft_consensus.cc:374] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.313323 17140 catalog_manager.cc:5495] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:42.316058 17666 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:42.317293 17513 raft_consensus.cc:729] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.317636 17666 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:42.318015 17666 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.318320 17513 consensus_queue.cc:260] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.321127 17513 ts_tablet_manager.cc:1428] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260929 11:36:42.322316 17513 tablet_bootstrap.cc:492] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:42.325296 17544 consensus_queue.cc:1035] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:42.329541 17513 tablet_bootstrap.cc:654] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.305994 17511 raft_consensus.cc:348] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.335368 17511 raft_consensus.cc:374] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.336061 17511 raft_consensus.cc:729] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.337631 17611 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.337246 17511 consensus_queue.cc:260] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.338263 17611 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.341014 17611 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:42.342727 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.334954 17666 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.343572 17611 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.343731 17314 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:42.344182 17611 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.345261 17511 ts_tablet_manager.cc:1428] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.042s user 0.006s sys 0.002s
I20260929 11:36:42.348568 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:42.349299 17391 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:42.349661 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:42.350055 17671 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.345431 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.350620 17671 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.346488 17206 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:42.351233 17666 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.350801 17511 tablet_bootstrap.cc:492] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:42.352559 17663 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:42.352944 17208 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:42.347337 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.353953 17314 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:42.354036 17554 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:42.354493 17554 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:42.354815 17554 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.350548 17464 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.353125 17663 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:42.357463 17663 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.363581 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:42.373760 17511 tablet_bootstrap.cc:654] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.373551 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.364703 17544 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.374370 17465 raft_consensus.cc:2379] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:42.374723 17544 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.377405 17544 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:42.365527 17671 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:42.378468 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:42.372987 17637 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.379304 17637 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.378470 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:42.379927 17431 leader_election.cc:341] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.370103 17512 tablet_bootstrap.cc:492] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
W20260929 11:36:42.380822 17429 leader_election.cc:341] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.381398 17637 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:42.381588 17512 ts_tablet_manager.cc:1397] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.118s user 0.026s sys 0.005s
I20260929 11:36:42.381417 17429 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.383065 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.366900 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:42.383723 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.384405 17465 raft_consensus.cc:2454] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:42.385536 17512 raft_consensus.cc:348] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.385558 17356 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:42.386554 17512 raft_consensus.cc:374] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.372279 17513 tablet_bootstrap.cc:492] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:42.383724 17314 raft_consensus.cc:2454] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:42.387336 17513 ts_tablet_manager.cc:1397] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.065s user 0.021s sys 0.028s
I20260929 11:36:42.387646 17582 raft_consensus.cc:2781] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:42.388039 17582 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:42.388453 17582 raft_consensus.cc:3037] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.388113 17544 raft_consensus.cc:2726] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.368057 17464 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:42.389772 17513 raft_consensus.cc:348] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.390177 17282 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:42.390497 17513 raft_consensus.cc:374] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.390775 17513 raft_consensus.cc:729] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.386822 17512 raft_consensus.cc:729] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.391258 17666 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.391772 17512 consensus_queue.cc:260] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.391788 17666 raft_consensus.cc:686] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:42.393751 17512 ts_tablet_manager.cc:1428] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260929 11:36:42.393334 17666 consensus_queue.cc:237] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:42.373117 17207 leader_election.cc:341] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.394315 17513 consensus_queue.cc:260] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.395961 17512 tablet_bootstrap.cc:492] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:42.397171 17207 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.397014 17554 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.399724 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:42.400358 17314 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.401366 17637 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.401916 17637 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.404258 17513 ts_tablet_manager.cc:1428] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260929 11:36:42.405264 17513 tablet_bootstrap.cc:492] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:42.405418 17637 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:42.311245 17515 tablet_bootstrap.cc:654] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.402535 17512 tablet_bootstrap.cc:654] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.408241 17314 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
W20260929 11:36:42.427150 17283 leader_election.cc:341] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.419601 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.392423 17611 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:42.434185 17206 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:42.415309 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.410001 17513 tablet_bootstrap.cc:654] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.435362 17611 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.435870 17611 raft_consensus.cc:686] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:42.434942 17582 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.418212 17668 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.437414 17668 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.436704 17611 consensus_queue.cc:237] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.439332 17668 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.441711 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.442672 17465 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:42.435406 17241 raft_consensus.cc:2379] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:42.409248 17663 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.426753 17528 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.444423 17282 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:42.447185 17588 raft_consensus.cc:2781] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:42.447598 17588 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:42.447954 17588 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.448295 17554 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:42.449295 17512 tablet_bootstrap.cc:492] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:42.449810 17512 ts_tablet_manager.cc:1397] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.054s user 0.014s sys 0.010s
I20260929 11:36:42.447108 17513 tablet_bootstrap.cc:492] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:42.451962 17513 ts_tablet_manager.cc:1397] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.047s user 0.021s sys 0.002s
I20260929 11:36:42.451797 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:42.444855 17357 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:42.452720 17314 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.444995 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:42.453536 17312 raft_consensus.cc:3037] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.454057 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:42.454705 17389 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.454713 17512 raft_consensus.cc:348] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.457286 17512 raft_consensus.cc:374] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.457628 17512 raft_consensus.cc:729] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.458478 17512 consensus_queue.cc:260] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.460541 17663 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:42.461858 17513 raft_consensus.cc:348] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.462795 17513 raft_consensus.cc:374] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.463177 17513 raft_consensus.cc:729] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.465936 17512 ts_tablet_manager.cc:1428] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260929 11:36:42.466940 17512 tablet_bootstrap.cc:492] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:42.467563 17544 consensus_queue.cc:1035] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260929 11:36:42.462307 17637 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.468613 17513 consensus_queue.cc:260] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.468667 17587 consensus_queue.cc:1035] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260929 11:36:42.477902 17515 tablet_bootstrap.cc:492] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:42.478622 17515 ts_tablet_manager.cc:1397] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.177s user 0.014s sys 0.000s
I20260929 11:36:42.470583 17312 raft_consensus.cc:2454] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:42.496778 17512 tablet_bootstrap.cc:654] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.494402 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.515350 17668 consensus_queue.cc:1035] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260929 11:36:42.501636 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:42.500350 17582 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:36:42.526078 17283 leader_election.cc:341] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.500074 17391 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.526098 17355 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:42.529193 17582 raft_consensus.cc:2781] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.482005 17515 raft_consensus.cc:348] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.525229 17389 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:42.501752 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:42.530539 17515 raft_consensus.cc:374] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.507704 17588 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.529822 17582 raft_consensus.cc:686] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:42.500272 17314 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:42.529209 17637 raft_consensus.cc:2726] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.533955 17515 raft_consensus.cc:729] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.545418 17513 ts_tablet_manager.cc:1428] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.093s user 0.006s sys 0.031s
I20260929 11:36:42.539220 17466 raft_consensus.cc:3037] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.546016 17515 consensus_queue.cc:260] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.546435 17513 tablet_bootstrap.cc:492] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:42.553194 17587 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.553761 17587 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.555819 17587 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:42.557672 17588 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.564507 17582 consensus_queue.cc:237] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:42.546381 17207 leader_election.cc:341] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.567806 17668 consensus_queue.cc:1035] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:42.569365 17515 ts_tablet_manager.cc:1428] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.090s user 0.009s sys 0.000s
I20260929 11:36:42.569562 17511 tablet_bootstrap.cc:492] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:42.569655 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.570231 17511 ts_tablet_manager.cc:1397] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.220s user 0.009s sys 0.011s
I20260929 11:36:42.570328 17515 tablet_bootstrap.cc:492] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:42.571259 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:42.571411 17206 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:42.571866 17465 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.572552 17611 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.573067 17611 raft_consensus.cc:686] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:42.569614 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:42.572836 17511 raft_consensus.cc:348] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.574142 17611 consensus_queue.cc:237] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.574764 17511 raft_consensus.cc:374] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.575093 17511 raft_consensus.cc:729] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.575793 17511 consensus_queue.cc:260] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.577500 17511 ts_tablet_manager.cc:1428] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260929 11:36:42.578222 17511 tablet_bootstrap.cc:492] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
W20260929 11:36:42.596746 17431 leader_election.cc:341] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.599186 17528 raft_consensus.cc:2726] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.537385 17137 catalog_manager.cc:5495] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
W20260929 11:36:42.622841 17283 leader_election.cc:341] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.623250 17654 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.623862 17654 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:42.625947 17654 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:42.629109 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.631152 17670 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.632047 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.631842 17670 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.632915 17312 raft_consensus.cc:2379] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:42.634227 17670 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.634173 17355 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:42.636008 17466 raft_consensus.cc:2454] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:42.637616 17638 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:42.638945 17511 tablet_bootstrap.cc:654] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.638548 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.640728 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:42.641327 17658 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.641806 17658 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:42.643289 17431 leader_election.cc:341] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.644894 17663 consensus_queue.cc:1035] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:42.645390 17658 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:42.647312 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:42.648563 17140 catalog_manager.cc:5495] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
W20260929 11:36:42.652704 17431 leader_election.cc:341] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.653230 17431 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:42.655668 17671 consensus_queue.cc:1035] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:42.656018 17637 consensus_queue.cc:1035] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:42.665072 17513 tablet_bootstrap.cc:654] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.675508 17515 tablet_bootstrap.cc:654] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:42.666028 17638 raft_consensus.cc:2726] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.666057 17670 raft_consensus.cc:2726] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.684279 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.677873 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:42.699536 17356 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:42.719564 17429 leader_election.cc:341] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:42.738502 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:42.748090 17512 tablet_bootstrap.cc:492] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:42.748678 17512 ts_tablet_manager.cc:1397] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.282s user 0.016s sys 0.018s
W20260929 11:36:42.750156 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 55413us
I20260929 11:36:42.750660 17611 consensus_queue.cc:1035] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:42.751679 17654 consensus_queue.cc:1035] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:42.753827 17727 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.754312 17727 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.744781 17465 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:42.756592 17429 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
W20260929 11:36:42.773839 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 57703.1us
I20260929 11:36:42.751125 17512 raft_consensus.cc:348] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.776891 17512 raft_consensus.cc:374] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.776201 17544 raft_consensus.cc:2726] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:42.756299 17727 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:42.793304 17513 tablet_bootstrap.cc:492] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:42.793447 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.794168 17513 ts_tablet_manager.cc:1397] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.248s user 0.023s sys 0.010s
I20260929 11:36:42.797794 17282 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:42.797712 17513 raft_consensus.cc:348] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.798760 17513 raft_consensus.cc:374] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:42.799105 17513 raft_consensus.cc:729] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
W20260929 11:36:42.799510 17282 leader_election.cc:341] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:42.799950 17513 consensus_queue.cc:260] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.801614 17668 raft_consensus.cc:2781] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:42.802094 17668 raft_consensus.cc:686] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:42.802910 17668 consensus_queue.cc:237] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.777283 17512 raft_consensus.cc:729] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:42.810397 17513 ts_tablet_manager.cc:1428] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20260929 11:36:42.826591 17513 tablet_bootstrap.cc:492] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:42.810583 17512 consensus_queue.cc:260] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.842391 17512 ts_tablet_manager.cc:1428] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.093s user 0.008s sys 0.000s
I20260929 11:36:42.827387 17663 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.809964 17611 consensus_queue.cc:1035] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260929 11:36:42.827329 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:42.846752 17512 tablet_bootstrap.cc:492] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:42.850257 17637 raft_consensus.cc:2726] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:42.851972 17513 tablet_bootstrap.cc:654] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:42.864923 17733 log.cc:924] Time spent T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260929 11:36:42.841759 17588 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.878656 17515 tablet_bootstrap.cc:492] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:42.879180 17515 ts_tablet_manager.cc:1397] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.309s user 0.010s sys 0.020s
I20260929 11:36:42.883867 17637 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:42.884461 17637 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:42.878460 17140 catalog_manager.cc:5495] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:42.847657 17663 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:42.889863 17588 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:42.913467 17637 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:42.937438 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 94265.9us
I20260929 11:36:42.975442 17511 tablet_bootstrap.cc:492] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:42.976186 17511 ts_tablet_manager.cc:1397] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.398s user 0.028s sys 0.078s
I20260929 11:36:42.980805 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:42.985548 17663 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.006563 17463 raft_consensus.cc:2379] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:43.012192 17511 raft_consensus.cc:348] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.018630 17511 raft_consensus.cc:374] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.019126 17511 raft_consensus.cc:729] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.019973 17511 consensus_queue.cc:260] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.022913 17511 ts_tablet_manager.cc:1428] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.046s user 0.007s sys 0.000s
I20260929 11:36:43.024101 17511 tablet_bootstrap.cc:492] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:43.009723 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.032267 17512 tablet_bootstrap.cc:654] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.034989 17515 raft_consensus.cc:348] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.035961 17515 raft_consensus.cc:374] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.036258 17515 raft_consensus.cc:729] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.036926 17515 consensus_queue.cc:260] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.039026 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:43.039721 17465 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:43.049453 17515 ts_tablet_manager.cc:1428] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.170s user 0.006s sys 0.001s
I20260929 11:36:43.053752 17515 tablet_bootstrap.cc:492] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:43.031457 17588 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:36:43.061053 17735 log.cc:924] Time spent T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.129s user 0.004s sys 0.000s
I20260929 11:36:43.061691 17356 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:43.063195 17637 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.063601 17637 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.063933 17637 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.064980 17582 consensus_queue.cc:1035] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.067030 17528 consensus_queue.cc:1035] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.071374 17511 tablet_bootstrap.cc:654] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.071516 17637 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:43.074251 17741 log.cc:924] Time spent T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.078s user 0.001s sys 0.000s
I20260929 11:36:43.074558 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:43.075194 17463 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.082590 17658 consensus_queue.cc:1035] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260929 11:36:43.082823 17357 leader_election.cc:341] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.037619 17668 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.091384 17668 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.092222 17463 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:43.093549 17668 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:43.093497 17356 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:43.094712 17654 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:43.095389 17654 raft_consensus.cc:686] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:43.096637 17654 consensus_queue.cc:237] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.103142 17513 tablet_bootstrap.cc:492] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:43.103826 17513 ts_tablet_manager.cc:1397] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.278s user 0.041s sys 0.037s
I20260929 11:36:43.104944 17515 tablet_bootstrap.cc:654] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.106632 17511 tablet_bootstrap.cc:492] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:43.107193 17511 ts_tablet_manager.cc:1397] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.083s user 0.008s sys 0.003s
I20260929 11:36:43.106737 17513 raft_consensus.cc:348] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.107717 17513 raft_consensus.cc:374] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.108039 17513 raft_consensus.cc:729] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.108831 17513 consensus_queue.cc:260] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.110565 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:43.111390 17283 leader_election.cc:341] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.111881 17283 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:43.113674 17512 tablet_bootstrap.cc:492] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:43.113934 17668 raft_consensus.cc:2726] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:43.114221 17512 ts_tablet_manager.cc:1397] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.271s user 0.012s sys 0.018s
I20260929 11:36:43.110863 17513 ts_tablet_manager.cc:1428] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260929 11:36:43.116197 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:43.117316 17513 tablet_bootstrap.cc:492] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:43.119040 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:43.119673 17637 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:43.120368 17357 leader_election.cc:341] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.123658 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:43.123417 17137 catalog_manager.cc:5495] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:43.127440 17511 raft_consensus.cc:348] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.128515 17511 raft_consensus.cc:374] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.130904 17671 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.131565 17671 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.133991 17671 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:43.117388 17283 leader_election.cc:341] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.135658 17511 raft_consensus.cc:729] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.136735 17511 consensus_queue.cc:260] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.141517 17512 raft_consensus.cc:348] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.145025 17512 raft_consensus.cc:374] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.145332 17512 raft_consensus.cc:729] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.149628 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:43.150024 17206 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:43.150449 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:43.150878 17671 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.151348 17464 raft_consensus.cc:2379] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:43.151938 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:43.152613 17466 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:43.153389 17528 consensus_queue.cc:1035] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.146049 17512 consensus_queue.cc:260] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.157130 17206 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:43.158384 17528 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.159600 17513 tablet_bootstrap.cc:654] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.160635 17671 raft_consensus.cc:2726] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:43.163342 17511 ts_tablet_manager.cc:1428] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.056s user 0.007s sys 0.000s
I20260929 11:36:43.164382 17511 tablet_bootstrap.cc:492] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:43.164819 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:43.165745 17463 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:43.169196 17528 raft_consensus.cc:2726] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:43.173033 17515 tablet_bootstrap.cc:492] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
W20260929 11:36:43.173781 17283 leader_election.cc:341] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.174111 17512 ts_tablet_manager.cc:1428] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.058s user 0.006s sys 0.000s
I20260929 11:36:43.178341 17512 tablet_bootstrap.cc:492] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:43.178274 17666 consensus_queue.cc:1035] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.175704 17515 ts_tablet_manager.cc:1397] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.122s user 0.009s sys 0.007s
I20260929 11:36:43.181962 17668 consensus_queue.cc:1035] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.185905 17515 raft_consensus.cc:348] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.186910 17515 raft_consensus.cc:374] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.187243 17515 raft_consensus.cc:729] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.188401 17515 consensus_queue.cc:260] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.192274 17515 ts_tablet_manager.cc:1428] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260929 11:36:43.192559 17282 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:43.193977 17512 tablet_bootstrap.cc:654] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.198177 17511 tablet_bootstrap.cc:654] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.199126 17727 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.199570 17727 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.199958 17727 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.197114 17282 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:43.208643 17744 raft_consensus.cc:2781] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.209062 17744 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.209411 17744 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.214710 17463 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.224713 17511 tablet_bootstrap.cc:492] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:43.229214 17511 ts_tablet_manager.cc:1397] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.065s user 0.014s sys 0.009s
I20260929 11:36:43.236311 17511 raft_consensus.cc:348] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.237394 17511 raft_consensus.cc:374] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.237792 17511 raft_consensus.cc:729] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.238931 17511 consensus_queue.cc:260] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.242352 17511 ts_tablet_manager.cc:1428] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.010s user 0.004s sys 0.003s
I20260929 11:36:43.241770 17140 catalog_manager.cc:5495] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:43.243305 17511 tablet_bootstrap.cc:492] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:43.253562 17528 consensus_queue.cc:1035] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:43.254313 17511 tablet_bootstrap.cc:654] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.264990 17744 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.271771 17727 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.276289 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:43.278033 17513 tablet_bootstrap.cc:492] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:43.278672 17513 ts_tablet_manager.cc:1397] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.162s user 0.006s sys 0.005s
I20260929 11:36:43.279755 17727 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:43.279954 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:43.280653 17462 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.277976 17242 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.289263 17528 consensus_queue.cc:1035] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:43.290311 17513 raft_consensus.cc:348] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.291218 17462 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:43.291544 17513 raft_consensus.cc:374] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.291893 17513 raft_consensus.cc:729] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.292544 17513 consensus_queue.cc:260] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.294600 17513 ts_tablet_manager.cc:1428] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.016s user 0.003s sys 0.003s
I20260929 11:36:43.294930 17242 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:43.295503 17513 tablet_bootstrap.cc:492] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:43.296066 17283 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:43.296952 17666 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:43.297429 17666 raft_consensus.cc:686] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:43.298271 17666 consensus_queue.cc:237] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.299427 17512 tablet_bootstrap.cc:492] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:43.299938 17512 ts_tablet_manager.cc:1397] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.122s user 0.010s sys 0.000s
I20260929 11:36:43.302428 17512 raft_consensus.cc:348] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.303143 17512 raft_consensus.cc:374] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.303408 17512 raft_consensus.cc:729] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.303444 17511 tablet_bootstrap.cc:492] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:43.304023 17511 ts_tablet_manager.cc:1397] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.061s user 0.005s sys 0.005s
I20260929 11:36:43.309154 17513 tablet_bootstrap.cc:654] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.309880 17727 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.310052 17511 raft_consensus.cc:348] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.310405 17727 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.304065 17512 consensus_queue.cc:260] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.313720 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.315493 17512 ts_tablet_manager.cc:1428] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260929 11:36:43.316717 17512 tablet_bootstrap.cc:492] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:43.316857 17727 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:43.316982 17283 leader_election.cc:341] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.323293 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:43.310777 17511 raft_consensus.cc:374] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.324977 17744 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:43.326042 17744 consensus_queue.cc:1035] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.328374 17745 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:43.328774 17512 tablet_bootstrap.cc:654] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.328938 17745 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.329761 17511 raft_consensus.cc:729] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.333931 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.335942 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:43.336925 17670 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.334319 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:43.337451 17670 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.333415 17745 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.338730 17464 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:43.339634 17670 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.336982 17466 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.341234 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.342142 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:43.344373 17431 leader_election.cc:341] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.344408 17429 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:43.345139 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:43.346063 17313 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:43.346872 17670 raft_consensus.cc:2726] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:43.347726 17637 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.348191 17637 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.350920 17637 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:43.352468 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:43.353590 17462 raft_consensus.cc:2454] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:43.332639 17511 consensus_queue.cc:260] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.355089 17356 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:43.356469 17654 raft_consensus.cc:2781] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.356927 17654 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.357249 17511 ts_tablet_manager.cc:1428] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.050s user 0.006s sys 0.000s
I20260929 11:36:43.357306 17654 raft_consensus.cc:3037] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.358583 17511 tablet_bootstrap.cc:492] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:43.360519 17745 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.361007 17745 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.362651 17637 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.363138 17637 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.363798 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:43.365300 17431 leader_election.cc:341] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.366214 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.367205 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:43.367587 17357 leader_election.cc:341] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.368232 17637 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:43.368568 17431 leader_election.cc:341] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.368942 17389 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.372954 17466 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:43.368990 17431 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:43.375381 17670 raft_consensus.cc:2726] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:43.377600 17139 catalog_manager.cc:5495] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:43.369071 17745 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:43.378981 17515 tablet_bootstrap.cc:492] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:43.380285 17389 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:43.382797 17654 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.387928 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:43.388931 17312 raft_consensus.cc:3037] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.383153 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:43.390075 17466 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:43.391178 17356 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:43.392347 17637 raft_consensus.cc:2781] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.392722 17637 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.393036 17637 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.393209 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:43.393981 17463 raft_consensus.cc:3037] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.383203 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:43.397284 17312 raft_consensus.cc:2454] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:43.389070 17654 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:43.398769 17515 tablet_bootstrap.cc:654] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.398494 17355 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:43.409878 17654 raft_consensus.cc:2781] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:43.410586 17654 raft_consensus.cc:686] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:43.410969 17282 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:43.411412 17654 consensus_queue.cc:237] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.417379 17727 raft_consensus.cc:2781] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.417829 17727 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.418202 17727 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.419695 17463 raft_consensus.cc:2454] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:43.425015 17283 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:43.425887 17588 raft_consensus.cc:2781] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:43.426362 17588 raft_consensus.cc:686] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:43.427124 17588 consensus_queue.cc:237] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.434607 17513 tablet_bootstrap.cc:492] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:43.435249 17513 ts_tablet_manager.cc:1397] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.140s user 0.019s sys 0.009s
W20260929 11:36:43.437382 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 92772.2us
I20260929 11:36:43.412216 17511 tablet_bootstrap.cc:654] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.448863 17515 tablet_bootstrap.cc:492] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:43.460426 17515 ts_tablet_manager.cc:1397] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.085s user 0.009s sys 0.009s
I20260929 11:36:43.449085 17429 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:43.463122 17670 raft_consensus.cc:2781] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.462958 17515 raft_consensus.cc:348] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.463797 17515 raft_consensus.cc:374] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.448944 17512 tablet_bootstrap.cc:492] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:43.464131 17515 raft_consensus.cc:729] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.450940 17727 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.463505 17670 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.464916 17670 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.452217 17637 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.465924 17727 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:43.449586 17513 raft_consensus.cc:348] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.468101 17513 raft_consensus.cc:374] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.468410 17513 raft_consensus.cc:729] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.469138 17513 consensus_queue.cc:260] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.466938 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:43.470342 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:43.448055 17140 catalog_manager.cc:5495] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:43.470971 17466 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.472069 17513 ts_tablet_manager.cc:1428] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
W20260929 11:36:43.471937 17283 leader_election.cc:341] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.473070 17513 tablet_bootstrap.cc:492] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:43.464918 17515 consensus_queue.cc:260] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.474143 17637 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:43.476011 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:43.477926 17357 leader_election.cc:341] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.464485 17512 ts_tablet_manager.cc:1397] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.148s user 0.005s sys 0.022s
I20260929 11:36:43.478500 17466 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:43.479627 17513 tablet_bootstrap.cc:654] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.479691 17356 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:43.479676 17515 ts_tablet_manager.cc:1428] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260929 11:36:43.481051 17637 raft_consensus.cc:2781] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:43.481766 17637 raft_consensus.cc:686] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:43.481570 17512 raft_consensus.cc:348] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.474856 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:43.458227 17588 consensus_queue.cc:1035] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260929 11:36:43.482632 17637 consensus_queue.cc:237] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.463383 17511 tablet_bootstrap.cc:492] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:43.485354 17511 ts_tablet_manager.cc:1397] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.127s user 0.014s sys 0.001s
I20260929 11:36:43.480765 17670 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.482667 17512 raft_consensus.cc:374] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.486531 17512 raft_consensus.cc:729] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.487641 17670 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.488637 17463 raft_consensus.cc:2379] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:43.488544 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:43.489867 17431 leader_election.cc:341] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.490304 17282 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:43.482630 17515 tablet_bootstrap.cc:492] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:43.491101 17588 raft_consensus.cc:2726] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:36:43.491266 17512 consensus_queue.cc:260] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.494606 17242 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.495795 17511 raft_consensus.cc:348] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.499119 17511 raft_consensus.cc:374] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.500437 17511 raft_consensus.cc:729] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.501240 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:43.501349 17511 consensus_queue.cc:260] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.502122 17312 raft_consensus.cc:2379] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:43.503372 17429 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:43.503784 17511 ts_tablet_manager.cc:1428] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.018s user 0.004s sys 0.002s
I20260929 11:36:43.504150 17745 raft_consensus.cc:2726] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:36:43.504760 17511 tablet_bootstrap.cc:492] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:43.512486 17670 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.513103 17670 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.516652 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:43.516901 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:43.518178 17431 leader_election.cc:341] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:43.518757 17429 leader_election.cc:341] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.519220 17429 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:43.520102 17781 raft_consensus.cc:2726] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:43.520259 17515 tablet_bootstrap.cc:654] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.522133 17137 catalog_manager.cc:5495] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:43.524132 17512 ts_tablet_manager.cc:1428] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.045s user 0.007s sys 0.001s
I20260929 11:36:43.525099 17512 tablet_bootstrap.cc:492] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:43.528425 17670 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:43.528566 17638 consensus_queue.cc:1035] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.534353 17513 tablet_bootstrap.cc:492] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:43.540127 17512 tablet_bootstrap.cc:654] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.543010 17513 ts_tablet_manager.cc:1397] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.070s user 0.039s sys 0.014s
I20260929 11:36:43.545621 17513 raft_consensus.cc:348] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.546324 17513 raft_consensus.cc:374] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.546543 17515 tablet_bootstrap.cc:492] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:43.547014 17515 ts_tablet_manager.cc:1397] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.003s
I20260929 11:36:43.549414 17515 raft_consensus.cc:348] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.550135 17515 raft_consensus.cc:374] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.550398 17515 raft_consensus.cc:729] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.546587 17513 raft_consensus.cc:729] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.552624 17513 consensus_queue.cc:260] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.556653 17513 ts_tablet_manager.cc:1428] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.013s user 0.006s sys 0.001s
I20260929 11:36:43.557561 17513 tablet_bootstrap.cc:492] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:43.550997 17515 consensus_queue.cc:260] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.563113 17515 ts_tablet_manager.cc:1428] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
I20260929 11:36:43.564093 17515 tablet_bootstrap.cc:492] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:43.570406 17139 catalog_manager.cc:5495] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:43.571610 17513 tablet_bootstrap.cc:654] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.572777 17511 tablet_bootstrap.cc:654] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.572777 17515 tablet_bootstrap.cc:654] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.583160 17654 consensus_queue.cc:1035] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260929 11:36:43.574703 17512 tablet_bootstrap.cc:492] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:43.596122 17512 ts_tablet_manager.cc:1397] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.071s user 0.029s sys 0.003s
I20260929 11:36:43.606142 17138 catalog_manager.cc:5495] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:43.610373 17512 raft_consensus.cc:348] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.611181 17512 raft_consensus.cc:374] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.611436 17512 raft_consensus.cc:729] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.612046 17512 consensus_queue.cc:260] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.614100 17512 ts_tablet_manager.cc:1428] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20260929 11:36:43.614915 17512 tablet_bootstrap.cc:492] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:43.618471 17745 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.619104 17511 tablet_bootstrap.cc:492] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:43.619815 17511 ts_tablet_manager.cc:1397] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.115s user 0.008s sys 0.002s
I20260929 11:36:43.619199 17745 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.626341 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:43.627301 17313 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:43.628711 17429 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:43.631850 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.633338 17781 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.633745 17781 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.634083 17781 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.635231 17513 tablet_bootstrap.cc:492] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:43.635733 17513 ts_tablet_manager.cc:1397] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.078s user 0.040s sys 0.026s
W20260929 11:36:43.636761 17431 leader_election.cc:341] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.638309 17513 raft_consensus.cc:348] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.639050 17513 raft_consensus.cc:374] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.639321 17513 raft_consensus.cc:729] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.639993 17513 consensus_queue.cc:260] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.641842 17513 ts_tablet_manager.cc:1428] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260929 11:36:43.641757 17511 raft_consensus.cc:348] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.642376 17745 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.642515 17511 raft_consensus.cc:374] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.642834 17511 raft_consensus.cc:729] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.643527 17513 tablet_bootstrap.cc:492] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:43.643445 17511 consensus_queue.cc:260] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.644999 17511 ts_tablet_manager.cc:1428] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.025s user 0.003s sys 0.003s
I20260929 11:36:43.646320 17515 tablet_bootstrap.cc:492] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:43.646879 17515 ts_tablet_manager.cc:1397] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.083s user 0.017s sys 0.019s
I20260929 11:36:43.648953 17513 tablet_bootstrap.cc:654] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.649551 17512 tablet_bootstrap.cc:654] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.649641 17515 raft_consensus.cc:348] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.650638 17515 raft_consensus.cc:374] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.650975 17515 raft_consensus.cc:729] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.653967 17515 consensus_queue.cc:260] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.656560 17515 ts_tablet_manager.cc:1428] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260929 11:36:43.657467 17515 tablet_bootstrap.cc:492] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:43.662814 17515 tablet_bootstrap.cc:654] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.664147 17511 tablet_bootstrap.cc:492] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:43.670002 17654 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.684494 17654 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.685665 17511 tablet_bootstrap.cc:654] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.687769 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:43.689450 17357 leader_election.cc:341] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.693362 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:43.694010 17513 tablet_bootstrap.cc:492] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:43.694535 17513 ts_tablet_manager.cc:1397] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.051s user 0.015s sys 0.019s
W20260929 11:36:43.694617 17355 leader_election.cc:341] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.695102 17355 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:43.695922 17637 raft_consensus.cc:2726] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:43.697803 17513 raft_consensus.cc:348] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.699441 17513 raft_consensus.cc:374] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.699718 17513 raft_consensus.cc:729] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.700421 17513 consensus_queue.cc:260] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.705011 17513 ts_tablet_manager.cc:1428] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.010s user 0.006s sys 0.002s
I20260929 11:36:43.705479 17515 tablet_bootstrap.cc:492] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:43.705873 17513 tablet_bootstrap.cc:492] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:43.705960 17515 ts_tablet_manager.cc:1397] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.049s user 0.008s sys 0.005s
I20260929 11:36:43.697353 17654 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.714460 17513 tablet_bootstrap.cc:654] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.715312 17515 raft_consensus.cc:348] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.715901 17515 raft_consensus.cc:374] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.716147 17515 raft_consensus.cc:729] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.716794 17515 consensus_queue.cc:260] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.719163 17515 ts_tablet_manager.cc:1428] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260929 11:36:43.720398 17515 tablet_bootstrap.cc:492] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:43.732069 17511 tablet_bootstrap.cc:492] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:43.732816 17511 ts_tablet_manager.cc:1397] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.069s user 0.017s sys 0.011s
I20260929 11:36:43.736274 17515 tablet_bootstrap.cc:654] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.739120 17727 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.743134 17727 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.745457 17727 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:43.747644 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.748452 17241 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:43.749395 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:43.751099 17283 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:43.752549 17744 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.753090 17744 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.753531 17744 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.732203 17654 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.767221 17744 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.770704 17512 tablet_bootstrap.cc:492] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:43.771404 17512 ts_tablet_manager.cc:1397] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.157s user 0.021s sys 0.022s
I20260929 11:36:43.771116 17511 raft_consensus.cc:348] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.771883 17511 raft_consensus.cc:374] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.772141 17511 raft_consensus.cc:729] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.759081 17781 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.774892 17781 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.775570 17511 consensus_queue.cc:260] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.775889 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:43.776693 17312 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.778756 17511 ts_tablet_manager.cc:1428] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.046s user 0.005s sys 0.000s
I20260929 11:36:43.778913 17512 raft_consensus.cc:348] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.781488 17512 raft_consensus.cc:374] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.781596 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:43.783584 17512 raft_consensus.cc:729] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
W20260929 11:36:43.783610 17431 leader_election.cc:341] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.785544 17511 tablet_bootstrap.cc:492] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:43.786424 17512 consensus_queue.cc:260] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:43.788906 17512 ts_tablet_manager.cc:1428] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.017s user 0.009s sys 0.000s
I20260929 11:36:43.789778 17512 tablet_bootstrap.cc:492] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:43.790609 17513 tablet_bootstrap.cc:492] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:43.791294 17513 ts_tablet_manager.cc:1397] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.086s user 0.020s sys 0.019s
I20260929 11:36:43.777105 17654 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.799774 17389 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:43.801889 17513 raft_consensus.cc:348] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.802723 17513 raft_consensus.cc:374] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.803011 17513 raft_consensus.cc:729] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.803638 17513 consensus_queue.cc:260] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.805800 17513 ts_tablet_manager.cc:1428] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20260929 11:36:43.807194 17513 tablet_bootstrap.cc:492] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:43.809428 17528 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.809970 17528 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.811853 17528 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.812129 17513 tablet_bootstrap.cc:654] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.814046 17515 tablet_bootstrap.cc:492] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:43.814564 17515 ts_tablet_manager.cc:1397] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.094s user 0.037s sys 0.001s
I20260929 11:36:43.817034 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.817130 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:43.817809 17242 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:43.818400 17314 raft_consensus.cc:2379] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:43.819047 17357 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:43.819959 17658 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.814848 17654 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:43.820341 17658 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.820827 17658 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.820604 17511 tablet_bootstrap.cc:654] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.822989 17512 tablet_bootstrap.cc:654] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.814553 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:43.825618 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:43.826092 17588 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.825752 17313 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:43.826584 17588 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.828506 17727 consensus_queue.cc:1035] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 11:36:43.829432 17207 leader_election.cc:341] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.830061 17206 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:43.835551 17528 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.836048 17528 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.836493 17528 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.838925 17515 raft_consensus.cc:348] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.839677 17515 raft_consensus.cc:374] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.839979 17515 raft_consensus.cc:729] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.840863 17515 consensus_queue.cc:260] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.839341 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:43.854545 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:43.855232 17389 raft_consensus.cc:2454] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
W20260929 11:36:43.856225 17283 leader_election.cc:341] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:43.857065 17283 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:43.858789 17727 raft_consensus.cc:2781] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:43.859169 17727 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:43.859495 17727 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.867229 17727 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.857900 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:43.867990 17588 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:43.869740 17637 consensus_queue.cc:1035] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.872443 17668 consensus_queue.cc:1035] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:43.874372 17658 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:43.875320 17511 tablet_bootstrap.cc:492] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:43.883807 17511 ts_tablet_manager.cc:1397] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.098s user 0.009s sys 0.005s
I20260929 11:36:43.882383 17242 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.885201 17744 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:43.904510 17513 tablet_bootstrap.cc:492] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:43.909597 17513 ts_tablet_manager.cc:1397] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.103s user 0.018s sys 0.005s
I20260929 11:36:43.886545 17312 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:43.921357 17515 ts_tablet_manager.cc:1428] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.106s user 0.014s sys 0.019s
I20260929 11:36:43.926554 17515 tablet_bootstrap.cc:492] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:43.928794 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:43.929688 17389 raft_consensus.cc:2379] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:43.930725 17513 raft_consensus.cc:348] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.931772 17513 raft_consensus.cc:374] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.932133 17513 raft_consensus.cc:729] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
W20260929 11:36:43.933779 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:43.935566 17511 raft_consensus.cc:348] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.941097 17668 consensus_queue.cc:1035] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:43.948415 17511 raft_consensus.cc:374] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:43.949461 17511 raft_consensus.cc:729] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:43.949286 17513 consensus_queue.cc:260] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:43.952224 17511 consensus_queue.cc:260] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:43.956090 17513 ts_tablet_manager.cc:1428] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.046s user 0.004s sys 0.003s
I20260929 11:36:43.957659 17513 tablet_bootstrap.cc:492] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:43.948576 17727 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:43.966424 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:43.967388 17389 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:43.972813 17513 tablet_bootstrap.cc:654] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:43.951911 17800 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:43.986176 17511 ts_tablet_manager.cc:1428] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.102s user 0.006s sys 0.001s
I20260929 11:36:43.987550 17511 tablet_bootstrap.cc:492] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:43.952652 17429 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:43.996521 17745 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:43.996574 17512 tablet_bootstrap.cc:492] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:43.997288 17512 ts_tablet_manager.cc:1397] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.208s user 0.006s sys 0.017s
I20260929 11:36:44.008176 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:43.998745 17745 raft_consensus.cc:686] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:44.013751 17745 consensus_queue.cc:237] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:43.996574 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 44045us
I20260929 11:36:44.025622 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:44.029206 17654 consensus_queue.cc:1035] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:43.994709 17800 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.031809 17239 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.032508 17638 consensus_queue.cc:1035] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.019582 17512 raft_consensus.cc:348] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.038426 17512 raft_consensus.cc:374] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.038791 17512 raft_consensus.cc:729] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.038916 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:44.039863 17512 consensus_queue.cc:260] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.042677 17512 ts_tablet_manager.cc:1428] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.045s user 0.006s sys 0.000s
I20260929 11:36:44.045245 17512 tablet_bootstrap.cc:492] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:44.083554 17512 tablet_bootstrap.cc:654] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.070992 17528 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.090657 17528 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:44.091537 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:36:44.092967 17207 leader_election.cc:341] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.099578 17242 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:44.068347 17658 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:44.112462 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:44.114944 17207 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:44.116930 17528 raft_consensus.cc:2726] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:44.118115 17389 raft_consensus.cc:2454] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:44.123543 17511 tablet_bootstrap.cc:654] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.108076 17800 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:36:44.128876 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 117109us
I20260929 11:36:44.133921 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:44.134586 17313 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.140136 17513 tablet_bootstrap.cc:492] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:44.140992 17513 ts_tablet_manager.cc:1397] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.183s user 0.038s sys 0.047s
I20260929 11:36:44.152575 17513 raft_consensus.cc:348] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.153527 17513 raft_consensus.cc:374] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.153925 17513 raft_consensus.cc:729] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.158655 17513 consensus_queue.cc:260] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.167160 17513 ts_tablet_manager.cc:1428] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.026s user 0.007s sys 0.001s
I20260929 11:36:44.171865 17515 tablet_bootstrap.cc:654] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.179531 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:44.182952 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 227143us
I20260929 11:36:44.183074 17314 raft_consensus.cc:2379] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:44.195086 17355 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:44.196374 17658 raft_consensus.cc:2726] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:36:44.180779 17800 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.197427 17800 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.199435 17800 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:44.201773 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:44.201910 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:44.202636 17463 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:44.204514 17207 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:44.222827 17511 tablet_bootstrap.cc:492] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:44.224047 17511 ts_tablet_manager.cc:1397] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.237s user 0.020s sys 0.011s
I20260929 11:36:44.211534 17313 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:44.243381 17814 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.243554 17283 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:44.244277 17745 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.243986 17814 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:44.229631 17208 leader_election.cc:341] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.239924 17801 raft_consensus.cc:2781] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:44.246356 17638 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.253806 17801 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:44.254305 17801 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.254216 17638 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.254997 17813 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.255545 17813 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:44.256075 17283 leader_election.cc:341] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.247062 17206 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:44.256908 17638 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:44.257592 17813 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:44.246954 17745 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.257790 17800 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:44.258423 17800 raft_consensus.cc:686] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:44.259333 17800 consensus_queue.cc:237] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.259424 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:44.260392 17463 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:44.261458 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:44.261593 17356 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:44.261958 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:44.262199 17314 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:44.262526 17638 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:44.263068 17638 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:44.262445 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:44.263270 17431 leader_election.cc:341] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.250183 17511 raft_consensus.cc:348] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.264640 17511 raft_consensus.cc:374] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.264995 17511 raft_consensus.cc:729] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.265820 17511 consensus_queue.cc:260] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.248001 17727 raft_consensus.cc:2781] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:44.263480 17638 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.271353 17512 tablet_bootstrap.cc:492] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:44.270627 17727 raft_consensus.cc:686] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:44.272680 17512 ts_tablet_manager.cc:1397] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.228s user 0.017s sys 0.000s
I20260929 11:36:44.273397 17727 consensus_queue.cc:237] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.273885 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:44.259445 17745 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:44.277343 17814 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:44.278128 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 73486.2us
W20260929 11:36:44.280493 17429 leader_election.cc:341] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.281080 17429 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:44.280754 17512 raft_consensus.cc:348] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.281913 17745 raft_consensus.cc:2726] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:44.282127 17512 raft_consensus.cc:374] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.282547 17512 raft_consensus.cc:729] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.282943 17283 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:44.283349 17512 consensus_queue.cc:260] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.284296 17588 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
W20260929 11:36:44.284603 17282 leader_election.cc:341] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.284809 17588 raft_consensus.cc:686] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:44.285715 17588 consensus_queue.cc:237] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.290011 17512 ts_tablet_manager.cc:1428] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260929 11:36:44.298750 17513 tablet_bootstrap.cc:492] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:44.300792 17637 consensus_queue.cc:1035] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.303828 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:44.310529 17511 ts_tablet_manager.cc:1428] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.080s user 0.006s sys 0.002s
I20260929 11:36:44.314651 17511 tablet_bootstrap.cc:492] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:44.316612 17512 tablet_bootstrap.cc:492] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:44.318812 17515 tablet_bootstrap.cc:492] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:44.319473 17515 ts_tablet_manager.cc:1397] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.393s user 0.011s sys 0.035s
I20260929 11:36:44.313251 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:44.346632 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:44.347563 17389 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:44.349946 17637 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.350487 17637 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.368310 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:44.368384 17745 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.369859 17745 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.371585 17745 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:44.372502 17727 consensus_queue.cc:1035] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 11:36:44.372727 17357 leader_election.cc:341] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.374696 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:44.376209 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:44.377694 17431 leader_election.cc:341] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.366647 17801 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:44.379933 17431 leader_election.cc:341] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.380393 17431 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:44.381165 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:44.381850 17390 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.382002 17781 raft_consensus.cc:2726] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:44.382036 17283 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:44.383716 17744 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:44.383971 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:44.384624 17463 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.384902 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:44.385636 17465 raft_consensus.cc:2454] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:44.384193 17744 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:44.386132 17744 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.364634 17637 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:44.392335 17356 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:44.392686 17463 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:44.393908 17207 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:44.395967 17528 raft_consensus.cc:2781] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:44.396560 17528 raft_consensus.cc:686] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:44.397408 17528 consensus_queue.cc:237] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.398255 17139 catalog_manager.cc:5495] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:44.399484 17390 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:44.394769 17658 raft_consensus.cc:2781] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:44.401091 17658 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:44.401511 17658 raft_consensus.cc:3037] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:44.403543 17283 leader_election.cc:341] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.404060 17283 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:44.380503 17801 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:44.400193 17139 catalog_manager.cc:5495] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:44.405570 17814 raft_consensus.cc:2726] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:44.423254 17513 tablet_bootstrap.cc:654] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.425585 17512 tablet_bootstrap.cc:654] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.429595 17744 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:44.414525 17283 leader_election.cc:341] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.442126 17638 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.449149 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:44.448523 17140 catalog_manager.cc:5495] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:44.441015 17515 raft_consensus.cc:348] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.450103 17515 raft_consensus.cc:374] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.450296 17515 raft_consensus.cc:729] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.450848 17515 consensus_queue.cc:260] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.455291 17744 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:44.457835 17515 ts_tablet_manager.cc:1428] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.138s user 0.003s sys 0.002s
I20260929 11:36:44.448865 17658 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.459203 17515 tablet_bootstrap.cc:492] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:44.467147 17511 tablet_bootstrap.cc:654] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:44.459204 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 45344.2us
I20260929 11:36:44.461906 17528 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.472152 17512 tablet_bootstrap.cc:492] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:44.471859 17528 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.472681 17512 ts_tablet_manager.cc:1397] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.156s user 0.013s sys 0.001s
I20260929 11:36:44.465174 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:44.474887 17463 raft_consensus.cc:3037] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.475246 17512 raft_consensus.cc:348] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.476034 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:44.467123 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:44.467649 17658 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:44.453226 17314 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.478282 17312 raft_consensus.cc:2379] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:44.479727 17528 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:44.481699 17638 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:44.476012 17512 raft_consensus.cc:374] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.483467 17512 raft_consensus.cc:729] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.484040 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:44.484165 17512 consensus_queue.cc:260] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.484757 17464 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.484989 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:44.487166 17392 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.488718 17512 ts_tablet_manager.cc:1428] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
W20260929 11:36:44.489140 17357 leader_election.cc:341] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.489748 17512 tablet_bootstrap.cc:492] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:44.492455 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:44.493438 17515 tablet_bootstrap.cc:654] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.495546 17512 tablet_bootstrap.cc:654] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.496299 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:44.497422 17465 raft_consensus.cc:2379] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:44.498580 17781 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.502359 17781 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.504820 17781 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:44.506807 17464 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:44.506985 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:44.508013 17356 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:36:44.508562 17431 leader_election.cc:341] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.508896 17654 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:44.509428 17654 raft_consensus.cc:686] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:44.510234 17654 consensus_queue.cc:237] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.514643 17513 tablet_bootstrap.cc:492] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:44.517189 17513 ts_tablet_manager.cc:1397] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.219s user 0.010s sys 0.015s
I20260929 11:36:44.515808 17314 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:44.515861 17392 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:44.522897 17513 raft_consensus.cc:348] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.524394 17513 raft_consensus.cc:374] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 11:36:44.523841 17283 leader_election.cc:341] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.525525 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:44.527096 17207 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:44.527591 17283 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:44.528195 17528 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.528731 17814 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:44.529366 17814 raft_consensus.cc:686] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
W20260929 11:36:44.530606 17431 leader_election.cc:341] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.530417 17814 consensus_queue.cc:237] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.531092 17431 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:44.533164 17781 raft_consensus.cc:2726] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:44.535640 17463 raft_consensus.cc:2454] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:44.536970 17356 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:44.538079 17638 raft_consensus.cc:2781] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:44.538549 17638 raft_consensus.cc:686] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:44.539326 17638 consensus_queue.cc:237] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.524704 17513 raft_consensus.cc:729] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.541353 17528 raft_consensus.cc:2726] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:44.541109 17513 consensus_queue.cc:260] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.543665 17513 ts_tablet_manager.cc:1428] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.026s user 0.001s sys 0.004s
I20260929 11:36:44.544652 17513 tablet_bootstrap.cc:492] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:44.546375 17511 tablet_bootstrap.cc:492] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:44.546976 17511 ts_tablet_manager.cc:1397] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.233s user 0.012s sys 0.001s
I20260929 11:36:44.549544 17512 tablet_bootstrap.cc:492] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:44.550119 17512 ts_tablet_manager.cc:1397] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.061s user 0.010s sys 0.001s
I20260929 11:36:44.551321 17513 tablet_bootstrap.cc:654] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.554328 17515 tablet_bootstrap.cc:492] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:44.554831 17515 ts_tablet_manager.cc:1397] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.096s user 0.018s sys 0.005s
I20260929 11:36:44.553326 17512 raft_consensus.cc:348] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.549711 17511 raft_consensus.cc:348] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.557394 17511 raft_consensus.cc:374] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.555648 17512 raft_consensus.cc:374] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.557714 17511 raft_consensus.cc:729] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.558808 17511 consensus_queue.cc:260] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.557557 17515 raft_consensus.cc:348] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.560578 17515 raft_consensus.cc:374] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.560876 17515 raft_consensus.cc:729] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.561517 17515 consensus_queue.cc:260] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.562002 17511 ts_tablet_manager.cc:1428] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.015s user 0.008s sys 0.001s
I20260929 11:36:44.563314 17511 tablet_bootstrap.cc:492] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:44.563702 17515 ts_tablet_manager.cc:1428] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260929 11:36:44.564884 17512 raft_consensus.cc:729] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.565080 17515 tablet_bootstrap.cc:492] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:44.566361 17512 consensus_queue.cc:260] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.574282 17511 tablet_bootstrap.cc:654] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.577055 17745 consensus_queue.cc:1035] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.577805 17242 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.578974 17512 ts_tablet_manager.cc:1428] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.029s user 0.007s sys 0.001s
I20260929 11:36:44.580384 17512 tablet_bootstrap.cc:492] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:44.586849 17515 tablet_bootstrap.cc:654] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.587404 17512 tablet_bootstrap.cc:654] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.594498 17513 tablet_bootstrap.cc:492] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:44.594980 17513 ts_tablet_manager.cc:1397] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.011s
I20260929 11:36:44.597700 17513 raft_consensus.cc:348] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.598397 17513 raft_consensus.cc:374] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.598672 17513 raft_consensus.cc:729] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.598706 17745 consensus_queue.cc:1035] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.599488 17513 consensus_queue.cc:260] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.602334 17513 ts_tablet_manager.cc:1428] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20260929 11:36:44.603224 17513 tablet_bootstrap.cc:492] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:44.611555 17745 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.612231 17745 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:44.613605 17814 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.614130 17814 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.615360 17745 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:44.616864 17513 tablet_bootstrap.cc:654] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.616521 17814 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:44.628021 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:44.634539 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:44.636622 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:44.643121 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:44.639019 17431 leader_election.cc:341] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:44.646643 17283 leader_election.cc:341] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:44.648617 17283 leader_election.cc:341] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.649055 17283 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:44.650147 17744 raft_consensus.cc:2726] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:36:44.651500 17431 leader_election.cc:341] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:44.652004 17431 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:44.653787 17745 raft_consensus.cc:2726] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:44.654326 17515 tablet_bootstrap.cc:492] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:44.654817 17515 ts_tablet_manager.cc:1397] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.090s user 0.014s sys 0.011s
I20260929 11:36:44.654631 17141 catalog_manager.cc:5495] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 1 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:44.656908 17512 tablet_bootstrap.cc:492] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:44.657402 17512 ts_tablet_manager.cc:1397] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.018s
I20260929 11:36:44.657796 17515 raft_consensus.cc:348] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.658572 17515 raft_consensus.cc:374] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.658833 17515 raft_consensus.cc:729] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.659401 17515 consensus_queue.cc:260] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.661811 17515 ts_tablet_manager.cc:1428] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260929 11:36:44.662698 17515 tablet_bootstrap.cc:492] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:44.662241 17512 raft_consensus.cc:348] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.663197 17512 raft_consensus.cc:374] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.663444 17512 raft_consensus.cc:729] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.664362 17512 consensus_queue.cc:260] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.666628 17512 ts_tablet_manager.cc:1428] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.009s user 0.005s sys 0.002s
I20260929 11:36:44.667490 17512 tablet_bootstrap.cc:492] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:44.680033 17512 tablet_bootstrap.cc:654] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.684294 17511 tablet_bootstrap.cc:492] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:44.687929 17515 tablet_bootstrap.cc:654] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.688403 17511 ts_tablet_manager.cc:1397] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.124s user 0.026s sys 0.022s
I20260929 11:36:44.694897 17513 tablet_bootstrap.cc:492] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:44.695458 17513 ts_tablet_manager.cc:1397] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.092s user 0.019s sys 0.012s
I20260929 11:36:44.696506 17744 consensus_queue.cc:1035] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.699697 17515 tablet_bootstrap.cc:492] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:44.700227 17515 ts_tablet_manager.cc:1397] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.004s
I20260929 11:36:44.702934 17515 raft_consensus.cc:348] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.703505 17515 raft_consensus.cc:374] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.703728 17515 raft_consensus.cc:729] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.704303 17515 consensus_queue.cc:260] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.709424 17515 ts_tablet_manager.cc:1428] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.009s user 0.001s sys 0.004s
I20260929 11:36:44.710474 17515 tablet_bootstrap.cc:492] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:44.699167 17513 raft_consensus.cc:348] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.713163 17513 raft_consensus.cc:374] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.714439 17513 raft_consensus.cc:729] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.715072 17513 consensus_queue.cc:260] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.717411 17513 ts_tablet_manager.cc:1428] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.022s user 0.006s sys 0.002s
I20260929 11:36:44.718307 17513 tablet_bootstrap.cc:492] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:44.728856 17511 raft_consensus.cc:348] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.729843 17511 raft_consensus.cc:374] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.730223 17511 raft_consensus.cc:729] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.731043 17511 consensus_queue.cc:260] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.734184 17511 ts_tablet_manager.cc:1428] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.045s user 0.004s sys 0.003s
I20260929 11:36:44.735112 17511 tablet_bootstrap.cc:492] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:44.735888 17512 tablet_bootstrap.cc:492] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:44.736557 17512 ts_tablet_manager.cc:1397] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.069s user 0.016s sys 0.001s
I20260929 11:36:44.737638 17513 tablet_bootstrap.cc:654] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:44.789343 17283 consensus_peers.cc:487] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a -> Peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Couldn't send request to peer 013a37bea2eb40c0ad4ce8f296176573. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:44.811966 17512 raft_consensus.cc:348] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.813972 17512 raft_consensus.cc:374] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.814357 17512 raft_consensus.cc:729] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.815371 17512 consensus_queue.cc:260] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:44.828948 17512 ts_tablet_manager.cc:1428] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.092s user 0.010s sys 0.004s
I20260929 11:36:44.845284 17515 tablet_bootstrap.cc:654] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.855517 17511 tablet_bootstrap.cc:654] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.858912 17140 catalog_manager.cc:5495] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:44.877982 17512 tablet_bootstrap.cc:492] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:44.886698 17801 consensus_queue.cc:1035] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.881103 17463 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.899106 17801 consensus_queue.cc:1035] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.916420 17668 consensus_queue.cc:1035] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.916941 17512 tablet_bootstrap.cc:654] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:44.914062 17513 tablet_bootstrap.cc:492] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:44.924506 17513 ts_tablet_manager.cc:1397] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.206s user 0.009s sys 0.005s
I20260929 11:36:44.926194 17800 consensus_queue.cc:1035] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.929211 17513 raft_consensus.cc:348] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.930537 17513 raft_consensus.cc:374] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.930940 17513 raft_consensus.cc:729] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.935016 17512 tablet_bootstrap.cc:492] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:44.935632 17512 ts_tablet_manager.cc:1397] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.058s user 0.010s sys 0.009s
I20260929 11:36:44.942819 17528 consensus_queue.cc:1035] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:44.931839 17513 consensus_queue.cc:260] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.954180 17515 tablet_bootstrap.cc:492] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:44.954898 17515 ts_tablet_manager.cc:1397] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.245s user 0.020s sys 0.002s
I20260929 11:36:44.959173 17512 raft_consensus.cc:348] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.960264 17512 raft_consensus.cc:374] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.960578 17512 raft_consensus.cc:729] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.963469 17512 consensus_queue.cc:260] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:44.967662 17511 tablet_bootstrap.cc:492] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:44.968536 17511 ts_tablet_manager.cc:1397] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.234s user 0.013s sys 0.021s
I20260929 11:36:44.975580 17528 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.976166 17528 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.979635 17528 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:44.984602 17727 consensus_queue.cc:1035] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260929 11:36:44.986426 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:44.987603 17392 raft_consensus.cc:2379] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:44.988123 17637 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:44.983915 17511 raft_consensus.cc:348] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.988713 17637 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.989465 17511 raft_consensus.cc:374] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:44.989817 17511 raft_consensus.cc:729] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:44.991191 17637 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:44.992048 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:44.994184 17206 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:44.994800 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:44.995535 17357 consensus_peers.cc:487] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af -> Peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Couldn't send request to peer 013a37bea2eb40c0ad4ce8f296176573. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:44.995628 17528 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:44.990466 17511 consensus_queue.cc:260] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:44.996372 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:44.997226 17511 ts_tablet_manager.cc:1428] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.028s user 0.001s sys 0.005s
I20260929 11:36:44.998677 17511 tablet_bootstrap.cc:492] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
W20260929 11:36:44.999150 17355 leader_election.cc:341] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:45.000288 17357 leader_election.cc:341] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.000782 17357 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:45.000921 17638 consensus_queue.cc:1035] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:45.002328 17588 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.002720 17638 raft_consensus.cc:2726] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:45.003005 17588 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.005129 17511 tablet_bootstrap.cc:654] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.005529 17588 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:45.011734 17822 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.012288 17822 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.014550 17822 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:45.016824 17637 consensus_queue.cc:1035] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:45.018680 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:45.019992 17465 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:45.017385 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:45.021713 17313 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:45.024557 17355 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:45.028079 17638 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:45.028563 17638 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.028914 17638 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.028837 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:45.029874 17466 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:45.031050 17282 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:45.032799 17588 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:45.033247 17588 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.033638 17800 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.034284 17800 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.030884 17515 raft_consensus.cc:348] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.035637 17515 raft_consensus.cc:374] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.036022 17515 raft_consensus.cc:729] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.046216 17515 consensus_queue.cc:260] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.033663 17588 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.054528 17512 ts_tablet_manager.cc:1428] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.119s user 0.008s sys 0.002s
I20260929 11:36:45.059640 17513 ts_tablet_manager.cc:1428] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.134s user 0.010s sys 0.000s
I20260929 11:36:45.060111 17528 raft_consensus.cc:2726] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:45.068863 17813 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.069047 17814 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.069442 17813 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.069651 17814 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.071762 17813 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:45.071805 17814 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:45.075786 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:45.066051 17139 catalog_manager.cc:5495] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.075800 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:45.082506 17844 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.083202 17844 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.085624 17844 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:45.086761 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:45.087565 17313 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:45.089218 17800 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:45.090356 17429 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:45.091106 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:45.091547 17745 raft_consensus.cc:2781] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:45.091974 17745 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.079721 17466 raft_consensus.cc:2454] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:45.101146 17513 tablet_bootstrap.cc:492] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:45.081357 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:45.096553 17745 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:45.091985 17313 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:45.125123 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:45.125958 17638 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.126010 17240 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:45.118324 17515 ts_tablet_manager.cc:1428] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.163s user 0.010s sys 0.001s
I20260929 11:36:45.118841 17282 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:45.120833 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:45.100971 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:45.133409 17390 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:45.133697 17392 raft_consensus.cc:2379] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:45.128163 17638 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:45.139053 17512 tablet_bootstrap.cc:492] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:45.138166 17727 raft_consensus.cc:2781] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:45.141933 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:45.142151 17781 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.142232 17727 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.142772 17727 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:45.143082 17282 leader_election.cc:341] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.142786 17781 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.141048 17206 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:45.147061 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:45.147456 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:45.148370 17781 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:45.143781 17515 tablet_bootstrap.cc:492] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
W20260929 11:36:45.163901 17431 leader_election.cc:341] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.164765 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:45.167196 17429 leader_election.cc:341] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.167743 17429 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:45.169189 17813 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.169844 17813 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.170542 17511 tablet_bootstrap.cc:492] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:45.171066 17511 ts_tablet_manager.cc:1397] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.173s user 0.010s sys 0.006s
I20260929 11:36:45.172086 17813 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:45.156749 17801 raft_consensus.cc:2781] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260929 11:36:45.154156 17283 leader_election.cc:341] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.175493 17844 raft_consensus.cc:2726] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:45.176576 17801 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.178658 17141 catalog_manager.cc:5495] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.192611 17141 catalog_manager.cc:5495] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.179236 17283 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:45.186691 17801 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.197345 17511 raft_consensus.cc:348] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.198897 17511 raft_consensus.cc:374] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.199134 17511 raft_consensus.cc:729] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.200486 17511 consensus_queue.cc:260] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.203387 17813 raft_consensus.cc:2726] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:45.204071 17654 consensus_queue.cc:1035] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260929 11:36:45.209599 17515 tablet_bootstrap.cc:654] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:45.214133 17863 log.cc:924] Time spent T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260929 11:36:45.217231 17512 tablet_bootstrap.cc:654] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.218124 17588 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.219632 17313 raft_consensus.cc:2379] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:45.222791 17745 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.224340 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:36:45.224543 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 73919.9us
I20260929 11:36:45.225049 17462 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:45.234325 17858 log.cc:924] Time spent T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.117s user 0.000s sys 0.000s
W20260929 11:36:45.239773 17860 log.cc:924] Time spent T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.078s user 0.001s sys 0.000s
I20260929 11:36:45.230545 17637 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.241868 17637 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.244535 17637 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:45.246840 17511 ts_tablet_manager.cc:1428] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.075s user 0.005s sys 0.002s
W20260929 11:36:45.250092 17283 leader_election.cc:341] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.251245 17814 consensus_queue.cc:1035] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:45.248243 17511 tablet_bootstrap.cc:492] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:45.264076 17513 tablet_bootstrap.cc:654] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.267798 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:45.230888 17588 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:45.255874 17801 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.278932 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:45.279708 17463 raft_consensus.cc:2454] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:45.280632 17801 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:45.286815 17745 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:45.288762 17515 tablet_bootstrap.cc:492] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:45.289315 17515 ts_tablet_manager.cc:1397] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.146s user 0.020s sys 0.020s
I20260929 11:36:45.291047 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:45.292049 17391 raft_consensus.cc:2379] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:45.293926 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:45.294770 17513 tablet_bootstrap.cc:492] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:45.295279 17513 ts_tablet_manager.cc:1397] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.200s user 0.014s sys 0.001s
I20260929 11:36:45.295018 17515 raft_consensus.cc:348] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.295888 17515 raft_consensus.cc:374] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.296176 17515 raft_consensus.cc:729] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.296542 17356 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:45.296864 17515 consensus_queue.cc:260] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.298892 17515 ts_tablet_manager.cc:1428] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260929 11:36:45.300426 17515 tablet_bootstrap.cc:492] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:45.301369 17637 raft_consensus.cc:2781] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:45.301956 17637 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.302421 17637 raft_consensus.cc:3037] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.344089 17511 tablet_bootstrap.cc:654] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.345285 17781 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.349326 17727 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:45.350208 17283 leader_election.cc:341] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.257661 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:45.355952 17513 raft_consensus.cc:348] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.357319 17513 raft_consensus.cc:374] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.357611 17513 raft_consensus.cc:729] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.358222 17513 consensus_queue.cc:260] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.359699 17515 tablet_bootstrap.cc:654] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.333736 17462 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:45.370429 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:45.371493 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:45.372210 17314 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.375100 17512 tablet_bootstrap.cc:492] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:45.375667 17512 ts_tablet_manager.cc:1397] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.270s user 0.010s sys 0.011s
I20260929 11:36:45.355598 17781 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.376286 17282 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:45.388826 17513 ts_tablet_manager.cc:1428] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.093s user 0.008s sys 0.000s
I20260929 11:36:45.395751 17356 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:45.376801 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:45.397372 17313 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:45.398640 17512 raft_consensus.cc:348] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.399416 17512 raft_consensus.cc:374] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.399667 17512 raft_consensus.cc:729] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.379344 17781 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:45.406405 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:45.409588 17512 consensus_queue.cc:260] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.384878 17727 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:45.416452 17513 tablet_bootstrap.cc:492] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
W20260929 11:36:45.420612 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 44469.1us
I20260929 11:36:45.415347 17654 raft_consensus.cc:2726] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:36:45.424120 17810 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:45.424845 17781 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.425371 17781 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.428121 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:45.429518 17513 tablet_bootstrap.cc:654] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.431530 17462 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:45.434230 17283 leader_election.cc:341] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.438287 17512 ts_tablet_manager.cc:1428] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.062s user 0.000s sys 0.007s
W20260929 11:36:45.438503 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 104892us
I20260929 11:36:45.437827 17810 raft_consensus.cc:686] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:45.448052 17810 consensus_queue.cc:237] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.451570 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:45.452381 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:45.452483 17312 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
W20260929 11:36:45.455731 17429 leader_election.cc:341] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.457984 17429 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:45.459262 17745 raft_consensus.cc:2781] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:45.459645 17745 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.459996 17745 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.464469 17512 tablet_bootstrap.cc:492] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
W20260929 11:36:45.460973 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 104007us
I20260929 11:36:45.474866 17314 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:45.475770 17637 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.480921 17797 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.496446 17797 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.498739 17206 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:45.499312 17797 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:45.500036 17869 raft_consensus.cc:2781] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:45.500567 17869 raft_consensus.cc:686] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:45.501433 17869 consensus_queue.cc:237] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.505457 17637 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:45.506494 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:45.507213 17465 raft_consensus.cc:3037] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:45.510085 17357 leader_election.cc:341] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.483230 17745 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.484308 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:45.444828 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 85149us
I20260929 11:36:45.462739 17781 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:45.522655 17431 leader_election.cc:341] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.523344 17431 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:45.524049 17511 tablet_bootstrap.cc:492] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:45.524798 17511 ts_tablet_manager.cc:1397] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.277s user 0.018s sys 0.009s
I20260929 11:36:45.525031 17844 raft_consensus.cc:2726] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:36:45.529596 17283 leader_election.cc:341] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.530161 17283 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:45.530444 17811 consensus_queue.cc:1035] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:45.531354 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:45.531901 17811 raft_consensus.cc:2726] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:45.532047 17239 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:45.534421 17465 raft_consensus.cc:2454] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:45.537245 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:45.537914 17241 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:45.540896 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:45.537676 17356 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:45.543283 17637 raft_consensus.cc:2781] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:45.543937 17637 raft_consensus.cc:686] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:45.547482 17637 consensus_queue.cc:237] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.468456 17313 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:45.557608 17511 raft_consensus.cc:348] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.561246 17511 raft_consensus.cc:374] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.561553 17511 raft_consensus.cc:729] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.562888 17511 consensus_queue.cc:260] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.568614 17429 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:45.569665 17844 raft_consensus.cc:2781] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:45.570171 17844 raft_consensus.cc:686] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:45.571085 17844 consensus_queue.cc:237] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.573818 17745 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:45.575762 17240 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.576370 17138 catalog_manager.cc:5495] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.581610 17239 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:45.581066 17141 catalog_manager.cc:5495] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.584658 17515 tablet_bootstrap.cc:492] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:45.585397 17515 ts_tablet_manager.cc:1397] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.285s user 0.018s sys 0.008s
I20260929 11:36:45.575591 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:45.589699 17512 tablet_bootstrap.cc:654] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:45.557171 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 47166us
I20260929 11:36:45.587998 17515 raft_consensus.cc:348] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.592839 17515 raft_consensus.cc:374] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.595433 17513 tablet_bootstrap.cc:492] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:45.596153 17513 ts_tablet_manager.cc:1397] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.188s user 0.038s sys 0.037s
I20260929 11:36:45.595149 17515 raft_consensus.cc:729] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.592120 17313 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.607955 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:45.608505 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:45.609162 17391 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:45.611021 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:45.612839 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:45.592372 17462 raft_consensus.cc:2454] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:45.616614 17515 consensus_queue.cc:260] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.627025 17511 ts_tablet_manager.cc:1428] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.102s user 0.006s sys 0.002s
I20260929 11:36:45.632368 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:45.633416 17236 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.653715 17236 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:45.655203 17282 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:45.659561 17668 raft_consensus.cc:2781] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:45.660259 17668 raft_consensus.cc:686] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:45.661427 17668 consensus_queue.cc:237] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.668896 17515 ts_tablet_manager.cc:1428] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.083s user 0.007s sys 0.000s
I20260929 11:36:45.671011 17141 catalog_manager.cc:5495] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.678539 17431 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:45.681600 17745 raft_consensus.cc:2781] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:45.682265 17745 raft_consensus.cc:686] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:45.683346 17745 consensus_queue.cc:237] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.688932 17208 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:45.692780 17357 leader_election.cc:341] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.699342 17138 catalog_manager.cc:5495] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 2, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.705349 17515 tablet_bootstrap.cc:492] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:45.720346 17511 tablet_bootstrap.cc:492] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:45.724377 17869 raft_consensus.cc:2726] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:45.741218 17511 tablet_bootstrap.cc:654] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.747977 17139 catalog_manager.cc:5495] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 1 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.759701 17313 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:45.762727 17513 raft_consensus.cc:348] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.763645 17513 raft_consensus.cc:374] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.763906 17513 raft_consensus.cc:729] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.764518 17513 consensus_queue.cc:260] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.766152 17513 ts_tablet_manager.cc:1428] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.168s user 0.004s sys 0.000s
I20260929 11:36:45.767201 17513 tablet_bootstrap.cc:492] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:45.770112 17813 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.770630 17813 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:45.773860 17797 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.774456 17797 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.777077 17797 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:45.780551 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:45.781672 17391 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:45.781616 17389 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:45.784828 17813 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:45.785989 17208 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:45.787544 17867 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:45.788107 17867 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.788398 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:45.788681 17867 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.796307 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:45.801548 17515 tablet_bootstrap.cc:654] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:45.802914 17206 leader_election.cc:341] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.807020 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:45.815321 17282 leader_election.cc:341] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:45.825178 17283 leader_election.cc:341] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.825642 17283 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:45.826476 17814 raft_consensus.cc:2726] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:45.838456 17512 tablet_bootstrap.cc:492] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:45.839083 17512 ts_tablet_manager.cc:1397] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.378s user 0.046s sys 0.045s
I20260929 11:36:45.848050 17138 catalog_manager.cc:5495] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.856297 17512 raft_consensus.cc:348] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.857200 17512 raft_consensus.cc:374] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.857474 17512 raft_consensus.cc:729] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.858283 17512 consensus_queue.cc:260] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.860733 17512 ts_tablet_manager.cc:1428] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260929 11:36:45.861770 17511 tablet_bootstrap.cc:492] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:45.862093 17512 tablet_bootstrap.cc:492] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:45.862270 17511 ts_tablet_manager.cc:1397] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.157s user 0.019s sys 0.011s
I20260929 11:36:45.853840 17867 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.868414 17512 tablet_bootstrap.cc:654] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.873096 17511 raft_consensus.cc:348] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.874032 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:45.877696 17511 raft_consensus.cc:374] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.878029 17389 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.878180 17511 raft_consensus.cc:729] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.879019 17511 consensus_queue.cc:260] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.881383 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:45.884709 17206 leader_election.cc:341] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:45.885376 17513 tablet_bootstrap.cc:654] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.892920 17389 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:45.894562 17208 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:45.875010 17867 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:45.895902 17867 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:45.898247 17511 ts_tablet_manager.cc:1428] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.036s user 0.006s sys 0.002s
I20260929 11:36:45.899549 17867 raft_consensus.cc:686] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:45.900527 17867 consensus_queue.cc:237] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.903087 17515 tablet_bootstrap.cc:492] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:45.903738 17515 ts_tablet_manager.cc:1397] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.226s user 0.023s sys 0.000s
I20260929 11:36:45.905616 17515 raft_consensus.cc:348] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.906075 17515 raft_consensus.cc:374] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.906222 17515 raft_consensus.cc:729] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.906742 17515 consensus_queue.cc:260] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.910070 17513 tablet_bootstrap.cc:492] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:45.910583 17513 ts_tablet_manager.cc:1397] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.144s user 0.016s sys 0.006s
I20260929 11:36:45.912843 17511 tablet_bootstrap.cc:492] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:45.913319 17513 raft_consensus.cc:348] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.914258 17513 raft_consensus.cc:374] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.914510 17513 raft_consensus.cc:729] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.915186 17513 consensus_queue.cc:260] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:45.917420 17513 ts_tablet_manager.cc:1428] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.007s user 0.003s sys 0.005s
I20260929 11:36:45.918669 17513 tablet_bootstrap.cc:492] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:45.918792 17511 tablet_bootstrap.cc:654] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.924072 17513 tablet_bootstrap.cc:654] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.929231 17515 ts_tablet_manager.cc:1428] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260929 11:36:45.936818 17515 tablet_bootstrap.cc:492] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:45.936641 17138 catalog_manager.cc:5495] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:45.941691 17528 consensus_queue.cc:1035] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:45.947103 17515 tablet_bootstrap.cc:654] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:45.951457 17512 tablet_bootstrap.cc:492] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:45.951992 17512 ts_tablet_manager.cc:1397] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.090s user 0.010s sys 0.004s
I20260929 11:36:45.954564 17512 raft_consensus.cc:348] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.955245 17512 raft_consensus.cc:374] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.955479 17512 raft_consensus.cc:729] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:45.957013 17658 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:45.957521 17658 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.959583 17658 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:45.960981 17668 consensus_queue.cc:1035] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:45.962869 17512 consensus_queue.cc:260] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:45.965191 17512 ts_tablet_manager.cc:1428] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.013s user 0.003s sys 0.003s
I20260929 11:36:45.975245 17512 tablet_bootstrap.cc:492] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:45.974200 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:45.974388 17528 consensus_queue.cc:1035] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260929 11:36:45.976632 17462 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:45.978698 17356 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:45.980698 17822 raft_consensus.cc:2781] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:45.981091 17822 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:45.981431 17822 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:45.990367 17511 tablet_bootstrap.cc:492] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:45.990936 17511 ts_tablet_manager.cc:1397] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.078s user 0.009s sys 0.008s
I20260929 11:36:45.992688 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:45.993386 17511 raft_consensus.cc:348] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:45.994125 17511 raft_consensus.cc:374] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:45.994375 17511 raft_consensus.cc:729] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.000427 17511 consensus_queue.cc:260] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:46.000998 17357 leader_election.cc:341] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.014716 17511 ts_tablet_manager.cc:1428] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260929 11:36:46.012100 17515 tablet_bootstrap.cc:492] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:46.016475 17515 ts_tablet_manager.cc:1397] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.080s user 0.018s sys 0.000s
I20260929 11:36:46.017166 17873 consensus_queue.cc:1035] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:46.017768 17511 tablet_bootstrap.cc:492] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:46.030099 17515 raft_consensus.cc:348] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.031073 17515 raft_consensus.cc:374] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:46.031425 17515 raft_consensus.cc:729] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.032191 17515 consensus_queue.cc:260] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.038969 17512 tablet_bootstrap.cc:654] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:46.044471 17814 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.045051 17814 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.045787 17867 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.046315 17867 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.047053 17814 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:46.048260 17867 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:46.050410 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:46.053803 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:46.062299 17513 tablet_bootstrap.cc:492] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:46.062814 17513 ts_tablet_manager.cc:1397] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.144s user 0.019s sys 0.013s
I20260929 11:36:46.064574 17207 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:46.065565 17515 ts_tablet_manager.cc:1428] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.049s user 0.006s sys 0.001s
I20260929 11:36:46.055140 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:46.056149 17242 raft_consensus.cc:3037] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.066989 17515 tablet_bootstrap.cc:492] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:46.072853 17528 raft_consensus.cc:2726] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:46.068275 17462 raft_consensus.cc:2454] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:46.095016 17282 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:46.095890 17727 raft_consensus.cc:2781] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:46.096288 17727 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:46.096645 17727 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.065200 17822 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.112762 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:46.114066 17357 leader_election.cc:341] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.117492 17781 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.118263 17781 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.118935 17513 raft_consensus.cc:348] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.119683 17513 raft_consensus.cc:374] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:46.119976 17513 raft_consensus.cc:729] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.120649 17513 consensus_queue.cc:260] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.122071 17822 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:46.123067 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:46.125349 17431 leader_election.cc:341] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.126423 17781 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:46.130594 17515 tablet_bootstrap.cc:654] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:46.132987 17513 ts_tablet_manager.cc:1428] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.049s user 0.005s sys 0.002s
I20260929 11:36:46.137174 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:46.134740 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 117397us
I20260929 11:36:46.144522 17658 consensus_queue.cc:1035] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:46.155267 17511 tablet_bootstrap.cc:654] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:46.156414 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:46.159739 17431 leader_election.cc:341] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.160236 17431 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:46.162029 17745 raft_consensus.cc:2726] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:36:46.167238 17283 leader_election.cc:341] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.185042 17513 tablet_bootstrap.cc:492] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:46.177973 17814 consensus_queue.cc:1035] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260929 11:36:46.187250 17844 consensus_queue.cc:1035] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:46.180639 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:46.191519 17462 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.200824 17314 raft_consensus.cc:1261] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260929 11:36:46.201591 17727 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.227836 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:36:46.229485 17283 leader_election.cc:341] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.232077 17462 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:46.244804 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:46.245592 17465 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.246038 17356 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:46.239755 17390 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.251780 17658 raft_consensus.cc:2781] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:46.252353 17658 raft_consensus.cc:686] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:46.236624 17844 consensus_queue.cc:1035] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260929 11:36:46.253227 17658 consensus_queue.cc:237] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.261004 17242 raft_consensus.cc:3037] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:46.235987 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 76281.2us
I20260929 11:36:46.235746 17727 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:46.280141 17588 consensus_queue.cc:1035] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:46.280759 17872 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.281271 17872 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.284198 17512 tablet_bootstrap.cc:492] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:46.284874 17512 ts_tablet_manager.cc:1397] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.310s user 0.020s sys 0.021s
I20260929 11:36:46.290372 17727 consensus_queue.cc:1035] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:46.293236 17872 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:46.295537 17511 tablet_bootstrap.cc:492] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:46.296237 17511 ts_tablet_manager.cc:1397] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.281s user 0.025s sys 0.023s
I20260929 11:36:46.296926 17745 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.297012 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:46.297588 17745 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.299506 17745 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:46.301105 17206 consensus_peers.cc:487] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 -> Peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Couldn't send request to peer a7e500c82a21469ab59f66205205a12a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:46.301846 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:46.307060 17239 raft_consensus.cc:1261] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260929 11:36:46.308408 17512 raft_consensus.cc:348] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:46.308933 17356 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:46.309162 17512 raft_consensus.cc:374] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:46.317632 17512 raft_consensus.cc:729] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.318459 17512 consensus_queue.cc:260] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:46.321365 17513 tablet_bootstrap.cc:654] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:46.355837 17515 tablet_bootstrap.cc:492] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:46.357208 17515 ts_tablet_manager.cc:1397] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.291s user 0.011s sys 0.011s
I20260929 11:36:46.352061 17869 consensus_queue.cc:1035] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:46.364904 17512 ts_tablet_manager.cc:1428] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.080s user 0.008s sys 0.000s
I20260929 11:36:46.381918 17637 raft_consensus.cc:2726] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:46.385412 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:46.394982 17515 raft_consensus.cc:348] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.395999 17515 raft_consensus.cc:374] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:46.397411 17515 raft_consensus.cc:729] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.398258 17515 consensus_queue.cc:260] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.439810 17515 ts_tablet_manager.cc:1428] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.082s user 0.008s sys 0.000s
I20260929 11:36:46.462083 17512 tablet_bootstrap.cc:492] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:46.454922 17727 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:46.471524 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 94657.6us
I20260929 11:36:46.475070 17727 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.479251 17727 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:46.481045 17515 tablet_bootstrap.cc:492] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:46.474653 17658 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:46.502707 17431 leader_election.cc:341] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.503799 17512 tablet_bootstrap.cc:654] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:46.504498 17844 consensus_queue.cc:1035] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:46.504396 17511 raft_consensus.cc:348] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:46.505172 17511 raft_consensus.cc:374] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:46.505416 17511 raft_consensus.cc:729] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.506006 17511 consensus_queue.cc:260] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:46.508277 17511 ts_tablet_manager.cc:1428] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.212s user 0.003s sys 0.000s
I20260929 11:36:46.498294 17813 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.550920 17465 raft_consensus.cc:2454] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:46.551976 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:46.552649 17282 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:46.552470 17813 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:46.554468 17668 raft_consensus.cc:2781] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:46.554536 17813 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:46.555019 17668 raft_consensus.cc:686] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:46.552686 17466 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:46.548110 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:46.557358 17282 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:46.558993 17918 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:46.559343 17918 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:46.559659 17918 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.562659 17844 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.563187 17844 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:46.565264 17844 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:46.568689 17918 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.571941 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:46.572671 17317 raft_consensus.cc:2454] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:46.573134 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:46.573763 17465 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.514397 17658 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.575536 17658 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:46.576637 17429 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:46.578841 17903 raft_consensus.cc:2781] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:46.579216 17903 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:46.579546 17903 raft_consensus.cc:3037] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.583014 17465 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:46.555898 17668 consensus_queue.cc:237] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:46.584470 17918 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:46.587392 17282 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:46.589205 17844 consensus_queue.cc:1035] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:46.588814 17918 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:46.593650 17918 raft_consensus.cc:686] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:46.595297 17918 consensus_queue.cc:237] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:46.597267 17431 leader_election.cc:341] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.599040 17431 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:46.600488 17745 raft_consensus.cc:2726] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:36:46.624364 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 152763us
I20260929 11:36:46.633925 17511 tablet_bootstrap.cc:492] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:46.660043 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:46.660926 17390 raft_consensus.cc:2454] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:46.665771 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:46.666793 17391 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:46.684935 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:46.631426 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 54576.8us
I20260929 11:36:46.718583 17283 leader_election.cc:302] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:46.723078 17813 raft_consensus.cc:2781] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:46.726197 17813 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:46.726521 17813 raft_consensus.cc:3037] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.726689 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:46.727569 17464 raft_consensus.cc:2379] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
W20260929 11:36:46.725127 17923 log.cc:924] Time spent T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.081s user 0.000s sys 0.001s
I20260929 11:36:46.727312 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:46.728796 17387 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.738322 17515 tablet_bootstrap.cc:654] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:46.738741 17139 catalog_manager.cc:5495] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 0 to 1, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 1 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:46.724917 17903 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:46.748245 17903 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:46.754153 17356 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:46.758653 17813 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:46.760085 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:46.778504 17513 tablet_bootstrap.cc:492] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:46.778940 17387 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:46.778991 17513 ts_tablet_manager.cc:1397] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.612s user 0.028s sys 0.073s
I20260929 11:36:46.782006 17822 raft_consensus.cc:2726] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:46.780455 17313 raft_consensus.cc:3037] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.799688 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:46.801486 17813 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:46.803550 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:46.804487 17387 raft_consensus.cc:3037] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:46.808785 17513 raft_consensus.cc:348] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:46.809556 17513 raft_consensus.cc:374] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:46.809811 17513 raft_consensus.cc:729] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.810880 17513 consensus_queue.cc:260] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:46.813143 17513 ts_tablet_manager.cc:1428] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260929 11:36:46.814055 17513 tablet_bootstrap.cc:492] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:46.816883 17387 raft_consensus.cc:2454] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:46.818380 17283 leader_election.cc:302] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:46.821288 17915 raft_consensus.cc:2781] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:46.824302 17915 raft_consensus.cc:686] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:46.825436 17915 consensus_queue.cc:237] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:46.842665 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:46.845360 17512 tablet_bootstrap.cc:492] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:46.845902 17512 ts_tablet_manager.cc:1397] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.396s user 0.064s sys 0.048s
I20260929 11:36:46.850350 17512 raft_consensus.cc:348] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:46.851166 17512 raft_consensus.cc:374] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:46.851439 17512 raft_consensus.cc:729] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.852243 17512 consensus_queue.cc:260] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:46.857920 17431 leader_election.cc:341] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:46.859167 17431 leader_election.cc:341] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.869364 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:46.871292 17513 tablet_bootstrap.cc:654] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:46.861361 17921 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.873422 17921 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.875519 17921 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:46.876291 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:46.878921 17208 leader_election.cc:341] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.896121 17512 ts_tablet_manager.cc:1428] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.050s user 0.007s sys 0.000s
I20260929 11:36:46.901328 17512 tablet_bootstrap.cc:492] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:46.910928 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:46.912742 17844 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:46.907475 17357 consensus_peers.cc:487] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af -> Peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Couldn't send request to peer 013a37bea2eb40c0ad4ce8f296176573. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:46.913300 17844 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:46.914371 17511 tablet_bootstrap.cc:654] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:46.914945 17844 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:46.915863 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:46.917270 17431 leader_election.cc:341] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.917162 17872 consensus_queue.cc:1035] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:46.933600 17313 raft_consensus.cc:2454] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:46.934958 17429 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:46.936282 17745 raft_consensus.cc:2781] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:46.936790 17745 raft_consensus.cc:686] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:46.955256 17745 consensus_queue.cc:237] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:46.956362 17515 tablet_bootstrap.cc:492] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:46.956863 17515 ts_tablet_manager.cc:1397] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.476s user 0.032s sys 0.026s
I20260929 11:36:46.959437 17515 raft_consensus.cc:348] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:46.966998 17515 raft_consensus.cc:374] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:46.967334 17515 raft_consensus.cc:729] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:46.967988 17515 consensus_queue.cc:260] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:46.972710 17515 ts_tablet_manager.cc:1428] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260929 11:36:46.973981 17515 tablet_bootstrap.cc:492] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:46.981401 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:46.987422 17745 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:46.988271 17745 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:46.991219 17283 leader_election.cc:341] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.993814 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:47.007290 17429 leader_election.cc:341] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:46.993188 17745 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:47.021783 17512 tablet_bootstrap.cc:654] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:47.040951 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:47.041939 17461 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:47.477092 17511 tablet_bootstrap.cc:492] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:47.477770 17511 ts_tablet_manager.cc:1397] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.856s user 0.028s sys 0.041s
I20260929 11:36:47.484622 17511 raft_consensus.cc:348] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:47.487643 17511 raft_consensus.cc:374] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:47.490789 17515 tablet_bootstrap.cc:654] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:47.497591 17513 tablet_bootstrap.cc:492] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:47.498075 17513 ts_tablet_manager.cc:1397] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.684s user 0.006s sys 0.016s
I20260929 11:36:47.494436 17511 raft_consensus.cc:729] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:47.499405 17511 consensus_queue.cc:260] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.630206 17939 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.633550 17940 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.643958 17941 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:48.643700 17939 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.661513 17945 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:48.662284 17945 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.658981 17941 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.670213 17939 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.654706 17940 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.673380 17940 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.674003 17941 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.674654 17941 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.677161 17940 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.677524 17939 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:48.695884 17941 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:48.713423 17429 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.250s user 0.030s sys 0.094s
W20260929 11:36:48.713778 17429 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.252s user 0.031s sys 0.095s
I20260929 11:36:48.697654 17940 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.712977 17945 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:48.718338 17940 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.698123 17939 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.720603 17939 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:48.721410 17947 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.722024 17947 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.724238 17947 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.724472 17948 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.725183 17948 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.727152 17940 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.727769 17948 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.705768 17949 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.727802 17940 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.730222 17949 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.729578 17948 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:48.731819 17940 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.732441 17948 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.731827 17941 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.734939 17949 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.739010 17948 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.747879 17951 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:48.748508 17951 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.750610 17951 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:48.751155 17951 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.751610 17951 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.705101 17944 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:48.752606 17944 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.754550 17941 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:48.755601 17944 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:48.755209 17941 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.756304 17947 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.758076 17940 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.758989 17940 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.757901 17954 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.759490 17945 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:48.759119 17941 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.767122 17940 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.755635 17951 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.767668 17939 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.765549 17945 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.769263 17952 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.769923 17942 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.770344 17945 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.756831 17947 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.769927 17952 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.770510 17942 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.772436 17947 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.772593 17942 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.773093 17942 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
W20260929 11:36:48.773177 17511 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.272s user 0.156s sys 0.228s
I20260929 11:36:48.769011 17939 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.773483 17947 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.773550 17951 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.774000 17947 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.774298 17951 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.775009 17939 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.775581 17939 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:36:48.773581 17511 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.272s user 0.156s sys 0.228s
I20260929 11:36:48.775988 17947 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.778565 17951 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:48.780449 17946 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.779302 17950 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.778262 17949 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.760080 17954 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.773578 17942 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.786217 17944 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.782636 17950 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.776053 17939 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.786734 17944 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.787624 17942 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.784915 17511 ts_tablet_manager.cc:1428] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 1.307s user 0.163s sys 0.230s
I20260929 11:36:48.787953 17939 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:48.788005 17950 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.788666 17944 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:48.788156 17511 ts_tablet_manager.cc:1460] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af: Tablet startup took 1310ms
W20260929 11:36:48.789964 17511 ts_tablet_manager.cc:1462] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af: Trace:
0929 11:36:39.390985 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:39.432727 (+ 41742us) service_pool.cc:227] Handling call
0929 11:36:39.544582 (+111855us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:36:39.544682 (+ 100us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:36:39.639490 (+ 94808us) tablet_metadata.cc:641] Metadata flushed
0929 11:36:39.786892 (+147402us) tablet_replica.cc:205] Creating consensus instance
0929 11:36:39.787374 (+ 482us) inbound_call.cc:173] Queueing success response
0929 11:36:46.604033 (+6816659us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0929 11:36:47.478083 (+874050us) ts_tablet_manager.cc:1429] Starting tablet replica
0929 11:36:47.482249 (+ 4166us) tablet_replica.cc:259] Starting instrumentation
0929 11:36:47.483065 (+ 816us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":1162541,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"tablet-open.queue_time_us":6729205,"thread_start_us":1275692,"threads_started":1}
I20260929 11:36:48.785672 17949 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.794587 17949 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.782636 17946 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.797806 17946 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:48.792572 17511 tablet_bootstrap.cc:492] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:48.801767 17948 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.805469 17948 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.808223 17948 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.802098 17944 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.810014 17944 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.814567 17955 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:48.815160 17955 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.815658 17944 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.817327 17955 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.817951 17953 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.818508 17953 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.800895 17942 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:48.822956 17953 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:48.831431 17946 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.849967 17946 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.852128 17946 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.828639 17511 tablet_bootstrap.cc:654] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:48.856951 17956 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.857580 17956 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.772614 17952 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:48.867679 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 66787.2us
I20260929 11:36:48.860124 17956 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:48.852600 17950 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:48.826341 17954 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.829784 17953 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.829597 17949 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.855590 17942 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.875351 17950 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.881737 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:48.881692 17949 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.884941 17944 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:48.894263 17207 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:48.903653 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.904439 17236 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:48.906000 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:48.906780 17457 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:48.907222 17950 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:48.880494 17946 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:48.908085 17459 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:48.902272 17955 raft_consensus.cc:2781] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:48.904434 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.922122 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.922873 17235 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:48.922936 17949 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:48.892570 17953 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.899442 17944 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.931941 17515 tablet_bootstrap.cc:492] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:48.930954 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:48.934840 17457 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:48.932862 17944 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:48.917474 17955 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:48.936836 17955 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:48.915154 17946 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.939365 17946 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:48.933725 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.929963 17961 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:48.941023 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:48.941208 17961 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.941730 17457 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:48.942587 17964 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:48.943326 17961 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:48.934263 17511 tablet_bootstrap.cc:492] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:48.944358 17511 ts_tablet_manager.cc:1397] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.152s user 0.014s sys 0.007s
I20260929 11:36:48.944705 17515 ts_tablet_manager.cc:1397] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 1.971s user 0.018s sys 0.018s
W20260929 11:36:48.947567 17512 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.979s user 0.039s sys 0.018s
W20260929 11:36:48.954299 17512 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.986s user 0.042s sys 0.018s
I20260929 11:36:48.943951 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.956761 17956 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.957440 17243 raft_consensus.cc:2454] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:48.957759 17956 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:48.958343 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.958559 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.948599 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.959982 17956 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:48.945603 17235 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:48.947460 17953 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:48.967031 17512 tablet_bootstrap.cc:492] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:48.967659 17512 ts_tablet_manager.cc:1397] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 2.067s user 0.055s sys 0.018s
I20260929 11:36:48.948892 17942 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:48.971735 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 51511us
I20260929 11:36:48.973726 17356 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:48.974011 17511 raft_consensus.cc:348] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.974822 17511 raft_consensus.cc:374] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:48.975185 17511 raft_consensus.cc:729] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:48.974576 17356 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:48.970880 17959 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.975944 17511 consensus_queue.cc:260] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.976459 17356 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:48.976580 17959 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:48.978250 17515 raft_consensus.cc:348] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.979274 17515 raft_consensus.cc:374] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:48.979575 17515 raft_consensus.cc:729] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:48.980252 17515 consensus_queue.cc:260] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:48.983527 17962 raft_consensus.cc:2781] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:48.986886 17511 ts_tablet_manager.cc:1428] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20260929 11:36:48.987573 17960 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.988628 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.987716 17356 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:48.981873 17953 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:48.987668 17959 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.989786 17515 ts_tablet_manager.cc:1428] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.045s user 0.003s sys 0.004s
I20260929 11:36:48.983943 17962 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:48.988729 17960 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:48.996467 17957 raft_consensus.cc:2781] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:48.996651 17515 tablet_bootstrap.cc:492] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:48.996897 17957 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.996160 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:48.985646 17948 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:48.985946 17946 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:48.985863 17956 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:48.998304 17959 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.001955 17959 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:49.001812 17956 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.002393 17959 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:48.999651 17960 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.943487 17964 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.000432 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.001163 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:48.995710 17962 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:48.997301 17957 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.004128 17242 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
W20260929 11:36:49.005031 17430 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.528s user 0.038s sys 0.070s
I20260929 11:36:49.005689 17956 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:48.993537 17953 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.007221 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:48.995051 17235 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:49.012822 17953 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.011206 17944 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.014599 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.015440 17242 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
W20260929 11:36:49.019474 17431 leader_election.cc:341] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.023013 17431 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.023133 17515 tablet_bootstrap.cc:654] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:49.026484 17512 raft_consensus.cc:348] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.027786 17512 raft_consensus.cc:374] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 11:36:49.021001 17430 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.549s user 0.039s sys 0.071s
I20260929 11:36:49.003129 17948 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.011615 17457 raft_consensus.cc:2454] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.003964 17946 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.028111 17512 raft_consensus.cc:729] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:49.031411 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.018599 17944 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.114132 17956 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.114717 17956 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.115284 17944 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.116446 17967 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.117002 17960 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.117548 17960 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.119503 17960 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.121914 17946 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.124696 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.125017 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.131414 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.131685 17956 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.132238 17386 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.162276 17512 consensus_queue.cc:260] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.132966 17944 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.171252 17966 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:49.172003 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.172091 17966 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.126583 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.173164 17954 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.184126 17958 raft_consensus.cc:2726] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:49.149001 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.116976 17967 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.193377 17939 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.194146 17939 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.196924 17967 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.198156 17939 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.199536 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.200503 17386 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.200954 17964 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.185031 17948 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.192340 17459 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.207427 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.207962 17969 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.207859 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.186985 17952 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.188879 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.210572 17512 ts_tablet_manager.cc:1428] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.243s user 0.009s sys 0.000s
I20260929 11:36:49.173049 17944 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.192618 17954 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.184774 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.209775 17956 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.222872 17956 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.218245 17964 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.226274 17957 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.226830 17964 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.208520 17969 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.212138 17948 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.213045 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.231941 17973 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.215718 17457 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.216722 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.234411 17955 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.234843 17953 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.235571 17948 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.236780 17954 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.211401 17952 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.228072 17458 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.217585 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.213903 17208 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:36:49.242030 17867 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.776s user 0.014s sys 0.019s
W20260929 11:36:49.256892 17867 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.791s user 0.015s sys 0.020s
I20260929 11:36:49.253304 17959 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.257663 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.258833 17460 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.258949 17386 raft_consensus.cc:2379] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:49.228931 17956 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.243589 17972 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.230479 17966 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.242776 17969 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.242776 17964 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.268127 17971 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.268779 17971 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.269204 17971 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.268467 17972 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.260658 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.263180 17967 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:36:49.264660 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 50822.5us
I20260929 11:36:49.260206 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.280434 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.283613 17242 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.284483 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.285396 17383 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:49.286549 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.287317 17383 raft_consensus.cc:2454] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:49.288540 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.288504 17967 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.291391 17967 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.291788 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.293505 17948 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.293944 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.294453 17924 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.294772 17236 raft_consensus.cc:2454] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.294961 17924 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.296207 17814 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.296732 17814 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.298624 17814 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.299062 17814 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.299451 17814 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.281319 17972 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.300937 17959 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.301435 17814 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.251935 17973 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.296079 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:49.281744 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 2.27812e+06us
I20260929 11:36:49.303318 17973 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.304673 17208 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.305467 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.306002 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.306655 17463 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.307030 17966 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.307410 17966 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.307760 17955 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.309450 17512 tablet_bootstrap.cc:492] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863: Bootstrap starting.
I20260929 11:36:49.307760 17966 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.311486 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.311693 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.282837 17952 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.312777 17962 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.273294 17957 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.278838 17944 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.336575 17386 raft_consensus.cc:2379] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:49.326854 17727 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.324999 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.353199 17389 raft_consensus.cc:1226] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:49.359460 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.363716 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.364012 17384 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.357252 17727 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.365232 17208 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.366458 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.366953 17727 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.367769 17515 tablet_bootstrap.cc:492] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:49.368279 17515 ts_tablet_manager.cc:1397] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.372s user 0.020s sys 0.034s
I20260929 11:36:49.369765 17431 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:49.370544 17953 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.371179 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.371701 17979 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.367743 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:49.372852 17384 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:49.372421 17979 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.373631 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.370846 17515 raft_consensus.cc:348] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.374606 17515 raft_consensus.cc:374] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:49.374876 17515 raft_consensus.cc:729] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:49.353513 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.378026 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.372196 17944 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.378729 17515 consensus_queue.cc:260] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.379427 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.364260 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.375979 17431 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:49.381986 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.357358 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.393043 17727 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.393549 17512 tablet_bootstrap.cc:654] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:49.393707 17727 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.385600 17944 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.393045 17463 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.396685 17944 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.397078 17814 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:49.397648 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:49.382797 17948 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.398485 17463 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:49.398538 17948 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.400520 17588 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.401130 17948 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.401298 17813 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:49.401134 17588 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.389907 17457 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.402473 17981 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.384830 17924 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.403178 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.403079 17981 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.403887 17457 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.404397 17924 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:49.405016 17391 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:49.404871 17924 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.405541 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.397600 17814 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:49.408775 17431 consensus_peers.cc:487] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 -> Peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Couldn't send request to peer 013a37bea2eb40c0ad4ce8f296176573. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:49.384501 17958 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.411214 17431 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:49.417652 17515 ts_tablet_manager.cc:1428] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.049s user 0.006s sys 0.001s
I20260929 11:36:49.418010 17431 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:49.405972 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.415120 17978 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
W20260929 11:36:49.414529 17283 leader_election.cc:341] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
W20260929 11:36:49.421126 17283 consensus_peers.cc:487] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a -> Peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Couldn't send request to peer 013a37bea2eb40c0ad4ce8f296176573. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260929 11:36:49.419458 17939 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.396168 17727 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.401959 17813 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.421964 17431 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:49.415840 17952 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.416857 17958 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.443528 17515 tablet_bootstrap.cc:492] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:49.421901 17954 raft_consensus.cc:2781] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:49.423628 17951 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.425565 17939 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:36:49.448127 17283 leader_election.cc:341] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.434537 17727 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.428411 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.429710 17948 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.433418 17952 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.453001 17924 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.424084 17978 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.445132 17954 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:49.443632 17982 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:49.445183 17958 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.431439 17971 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.451555 17939 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.448395 17588 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.456161 17979 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.541994 17242 raft_consensus.cc:2379] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:49.453477 17962 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.456653 17952 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.531682 17954 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:49.533299 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.532459 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.551050 17814 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.553094 17813 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.554069 17515 tablet_bootstrap.cc:654] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:49.450204 17951 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.550082 17512 tablet_bootstrap.cc:492] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863: No bootstrap required, opened a new log
I20260929 11:36:49.554574 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.453516 17727 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.563442 17512 ts_tablet_manager.cc:1397] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863: Time spent bootstrapping tablet: real 0.254s user 0.012s sys 0.005s
I20260929 11:36:49.468526 17948 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.554574 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.546042 17981 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.561375 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.557305 17588 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:36:49.584764 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 134294us
I20260929 11:36:49.577389 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.578367 17357 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.586700 17588 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.587049 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.589375 17512 raft_consensus.cc:348] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.566169 17978 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.595127 17512 raft_consensus.cc:374] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:49.601163 17512 raft_consensus.cc:729] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Initialized, Role: FOLLOWER
I20260929 11:36:49.602053 17512 consensus_queue.cc:260] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.594372 17962 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:36:49.604519 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800059ba0 after lost signal to thread 14202
W20260929 11:36:49.606774 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 184861us
I20260929 11:36:49.607509 17431 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:49.608043 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.610529 17951 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.611153 17951 raft_consensus.cc:2781] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.611227 17727 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.611549 17951 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.611910 17431 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:49.600782 17966 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.612818 17948 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.611375 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.612035 17951 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.534471 17982 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.619831 17512 ts_tablet_manager.cc:1428] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863: Time spent starting tablet: real 0.050s user 0.008s sys 0.000s
I20260929 11:36:49.620131 17463 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.620532 17924 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.622843 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.604529 17962 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:36:49.629443 17283 leader_election.cc:341] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.629563 17357 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.606997 17978 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.637061 17983 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.637960 17983 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.638648 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.608093 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.640996 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.643399 17988 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.643857 17979 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.631208 17283 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.640035 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.615651 17384 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:49.626334 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:49.656109 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 44278.8us
I20260929 11:36:49.641702 17962 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.644783 17942 raft_consensus.cc:2781] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.659209 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.662324 17971 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.648964 17966 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.659343 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.662386 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.661854 17994 raft_consensus.cc:2781] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.656353 17981 raft_consensus.cc:2726] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:49.647023 17668 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:49.629276 17939 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.662760 17942 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.629514 17924 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.644977 17978 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.667057 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.676970 17942 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.663748 17982 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.669417 17283 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.656831 17979 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.668172 17994 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.663859 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.666332 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.674727 17668 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.667474 17588 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.661123 17238 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:49.667762 17983 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.679363 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.690086 17207 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:49.679380 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.674881 17944 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.687932 17991 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.686434 17814 raft_consensus.cc:2726] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.696120 17668 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.665131 17988 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.696846 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.697043 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.688911 17994 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.655820 17952 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.699172 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.702872 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.703382 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.705032 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.707106 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.721201 17944 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.713419 17983 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:49.698452 17283 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.716849 17317 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.717094 17978 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.718003 17939 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.717900 17996 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.718401 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.720821 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.750341 17996 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.701939 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.738651 17924 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.736057 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:49.755311 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 55619.8us
W20260929 11:36:49.724498 17357 leader_election.cc:341] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.704241 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.709805 17991 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.715412 17948 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.725869 17313 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.710978 17207 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:49.746143 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 47731.1us
I20260929 11:36:49.737675 17234 raft_consensus.cc:2379] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:49.739876 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.756716 17431 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.719035 17958 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.758818 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:49.760982 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 50119.8us
I20260929 11:36:49.753701 17996 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.748718 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.753332 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.753312 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.753480 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.754278 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.752453 18000 raft_consensus.cc:2726] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.769243 17979 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:49.754549 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:49.744625 17208 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.772488 17431 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.773311 17207 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.771965 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.748487 17983 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.761487 17944 raft_consensus.cc:2726] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.759861 17948 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.779243 17515 tablet_bootstrap.cc:492] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:49.759891 17991 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.781706 17431 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.782857 17207 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.788154 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:49.789628 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 52488.6us
I20260929 11:36:49.790688 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.786183 17515 ts_tablet_manager.cc:1397] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.356s user 0.021s sys 0.006s
I20260929 11:36:49.791460 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.791889 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.792481 17955 raft_consensus.cc:2781] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:49.792565 17314 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.792703 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.785709 17973 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.774469 17235 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:49.793428 17973 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.793886 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:49.791409 17208 leader_election.cc:341] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.794528 17318 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:49.793919 17973 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.795783 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.787392 17948 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.781894 18002 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.798048 17431 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.784866 17996 raft_consensus.cc:2781] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:36:49.802940 17431 leader_election.cc:341] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.804502 17513 raft_consensus.cc:348] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.806197 17513 raft_consensus.cc:374] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:49.810634 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.811220 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.811867 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:49.802179 18002 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.812768 17384 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.813233 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.814059 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.812078 17460 raft_consensus.cc:2454] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:49.806529 17513 raft_consensus.cc:729] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:49.793483 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.816254 17207 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.779834 17954 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.818171 17513 consensus_queue.cc:260] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.818421 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.801317 17944 raft_consensus.cc:2726] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.821858 17207 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.822808 17207 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:49.815662 17997 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.823441 17207 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.828255 17513 ts_tablet_manager.cc:1428] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 2.330s user 0.013s sys 0.000s
W20260929 11:36:49.829352 17513 ts_tablet_manager.cc:1460] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: Tablet startup took 2331ms
I20260929 11:36:49.830964 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.831699 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.832178 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:49.832971 17458 raft_consensus.cc:1226] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:49.833382 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.834066 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.834580 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.835321 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.835749 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.836480 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.836645 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.836977 17958 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.837308 17457 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 0.
I20260929 11:36:49.838182 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.838665 17954 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.839277 17988 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:49.828166 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.823804 17314 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.841099 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:49.824370 17966 raft_consensus.cc:2726] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.843535 17983 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.815022 17996 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.843910 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.844286 17996 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.824035 17967 raft_consensus.cc:2781] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.835462 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:49.856139 17431 leader_election.cc:341] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.812783 18002 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.801949 18001 raft_consensus.cc:2726] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.830660 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.828439 17952 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:49.847700 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.830731 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.852212 17944 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.849098 17240 raft_consensus.cc:2454] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:49.849444 17951 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.832923 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:49.872305 17383 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.868683 17355 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:49.830717 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:49.873222 17311 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:49.873981 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.842250 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:49.853343 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:49.853435 17208 leader_election.cc:341] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.853976 17971 raft_consensus.cc:2781] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.854703 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.828563 17515 raft_consensus.cc:348] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.829108 17997 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.855993 17967 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.839319 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.867094 17944 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.869803 17316 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:49.890407 17944 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.871531 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.891353 17461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 75) took 1092 ms. Trace:
I20260929 11:36:49.881070 17460 raft_consensus.cc:1226] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:49.891776 17461 rpcz_store.cc:276] 0929 11:36:48.801101 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.890449 (+1089348us) service_pool.cc:227] Handling call
0929 11:36:49.890833 (+ 384us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:49.891023 (+ 190us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:49.891050 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:49.891089 (+ 39us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:49.891124 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:49.891183 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:49.891295 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:49.893047 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.893224 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.893929 17461 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:49.894200 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:49.894779 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:49.895358 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.880972 17971 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:49.896083 17971 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.872601 17462 raft_consensus.cc:1226] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:49.850675 17511 tablet_bootstrap.cc:492] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:49.887645 17967 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.875301 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.881287 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.882268 17515 raft_consensus.cc:374] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:49.904886 17515 raft_consensus.cc:729] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:49.896863 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 130) took 1019 ms. Trace:
I20260929 11:36:49.905592 17462 rpcz_store.cc:276] 0929 11:36:48.877979 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.872070 (+994091us) service_pool.cc:227] Handling call
0929 11:36:49.872428 (+ 358us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:49.896621 (+ 24193us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:49.896808 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:49.906627 17241 raft_consensus.cc:1226] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:49.886825 17997 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.898797 17459 raft_consensus.cc:1226] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:49.908458 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.904408 17139 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41942 (request call id 56) took 3169 ms. Trace:
I20260929 11:36:49.867470 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:49.905593 17515 consensus_queue.cc:260] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.862874 17955 raft_consensus.cc:686] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:49.891705 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:49.912212 17457 raft_consensus.cc:2379] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:49.906857 17390 raft_consensus.cc:2379] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:49.880352 17942 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:49.895383 17461 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.932267 17356 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:49.928782 18001 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:49.933458 17953 raft_consensus.cc:2726] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.933297 18001 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:49.934947 17356 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:49.917845 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:49.936393 17957 raft_consensus.cc:2781] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:49.936759 17957 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:36:49.936839 17283 leader_election.cc:341] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.937139 17957 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:49.930912 17515 ts_tablet_manager.cc:1428] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.139s user 0.004s sys 0.006s
I20260929 11:36:49.939631 17356 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:49.940744 17966 consensus_queue.cc:1046] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:49.941279 17356 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:49.941861 17207 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.941944 17966 raft_consensus.cc:3032] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:49.942169 17953 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:36:49.943861 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 86822us
I20260929 11:36:49.942436 17966 raft_consensus.cc:729] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:49.947221 17283 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:36:49.947806 17431 leader_election.cc:341] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.949203 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.954200 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:49.954245 18004 raft_consensus.cc:2726] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.955595 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:49.958673 17431 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.960237 17431 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.942579 17953 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:49.963750 17955 consensus_queue.cc:237] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:49.965112 17386 raft_consensus.cc:1226] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:49.971127 17383 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:49.909075 17139 rpcz_store.cc:276] 0929 11:36:46.729529 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:46.729682 (+ 153us) service_pool.cc:227] Handling call
0929 11:36:49.899311 (+3169629us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0929 11:36:46.923737 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0929 11:36:46.924283 (+ 546us) write_op.cc:432] Acquiring schema lock in shared mode
0929 11:36:46.924312 (+ 29us) write_op.cc:435] Acquired schema lock
0929 11:36:46.924352 (+ 40us) tablet.cc:660] Decoding operations
0929 11:36:46.924738 (+ 386us) write_op.cc:620] Acquiring the partition lock for write op
0929 11:36:46.924822 (+ 84us) write_op.cc:641] Partition lock acquired for write op
0929 11:36:46.924865 (+ 43us) tablet.cc:683] Acquiring locks for 1 operations
0929 11:36:46.925087 (+ 222us) tablet.cc:699] Row locks acquired
0929 11:36:46.925105 (+ 18us) write_op.cc:260] PREPARE: finished
0929 11:36:46.925249 (+ 144us) write_op.cc:270] Start()
0929 11:36:46.925371 (+ 122us) write_op.cc:276] Timestamp: P: 1790681806925210 usec, L: 0
0929 11:36:46.925393 (+ 22us) op_driver.cc:331] REPLICATION: starting
0929 11:36:46.926103 (+ 710us) log.cc:842] Serialized 543 byte log entry
0929 11:36:46.971462 (+ 45359us) op_driver.cc:444] REPLICATION: finished
0929 11:36:47.474282 (+502820us) write_op.cc:301] APPLY: starting
0929 11:36:47.478009 (+ 3727us) tablet.cc:1365] starting BulkCheckPresence
0929 11:36:47.483524 (+ 5515us) tablet.cc:1368] finished BulkCheckPresence
0929 11:36:47.483656 (+ 132us) tablet.cc:1370] starting ApplyRowOperation cycle
0929 11:36:47.483895 (+ 239us) tablet.cc:1381] finished ApplyRowOperation cycle
0929 11:36:47.484048 (+ 153us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0929 11:36:47.484089 (+ 41us) write_op.cc:312] APPLY: finished
0929 11:36:47.484354 (+ 265us) log.cc:842] Serialized 22 byte log entry
0929 11:36:47.484540 (+ 186us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:36:47.484629 (+ 89us) write_op.cc:454] Released schema lock
0929 11:36:47.484667 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0929 11:36:47.484921 (+ 254us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:36:47.484943 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":490325,"apply.run_cpu_time_us":2014,"apply.run_wall_time_us":15653,"num_ops":1,"prepare.queue_time_us":143253,"prepare.run_cpu_time_us":2688,"prepare.run_wall_time_us":4991,"replication_time_us":45971,"thread_start_us":143711,"threads_started":2}]]}
I20260929 11:36:49.962385 17952 raft_consensus.cc:2726] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.965449 17515 tablet_bootstrap.cc:492] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:49.974608 17387 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:49.972172 17953 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:49.975847 17283 leader_election.cc:341] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:49.963361 17431 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.980195 17283 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.918498 17355 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:49.984143 17283 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.990387 17283 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:49.975755 17999 raft_consensus.cc:2726] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.978121 17950 raft_consensus.cc:2726] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.988404 17385 raft_consensus.cc:2379] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:49.988631 17952 raft_consensus.cc:2781] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:49.985785 17983 raft_consensus.cc:2781] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:49.998318 17942 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:49.998425 17983 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:49.985038 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.998931 17994 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.994517 17814 raft_consensus.cc:2726] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:36:49.995723 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 87431.3us
I20260929 11:36:50.001819 17384 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:50.002775 17948 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.997618 17944 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:49.992028 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:49.989362 17924 raft_consensus.cc:2726] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:49.996912 17952 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:50.000002 17971 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:50.093462 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 136229us
I20260929 11:36:50.076529 17951 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:50.074214 17983 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.078133 17942 raft_consensus.cc:2781] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.075812 18003 raft_consensus.cc:2781] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:50.077831 17237 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:50.125217 17511 tablet_bootstrap.cc:654] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:50.071858 17358 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.13.221.254:34761, user_credentials={real_user=slave}} blocked reactor thread for 63948.4us
I20260929 11:36:50.120496 17952 raft_consensus.cc:3037] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:50.128280 17172 debug-util.cc:398] Leaking SignalData structure 0x7b080005a1c0 after lost signal to thread 17175
I20260929 11:36:49.997288 17966 consensus_queue.cc:260] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.153113 17283 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:50.126951 17386 raft_consensus.cc:1226] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
W20260929 11:36:50.151752 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 197471us
I20260929 11:36:50.154255 17356 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:50.139257 17465 raft_consensus.cc:1226] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.136869 18003 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:50.130275 17942 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:50.146656 17985 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.158344 17814 raft_consensus.cc:2781] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.132014 17962 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:50.163532 18003 raft_consensus.cc:3037] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.166541 17942 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.168819 17985 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:50.176777 17966 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:50.183149 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800359220 after lost signal to thread 17267
I20260929 11:36:50.177507 17814 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
W20260929 11:36:50.200055 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 45898.6us
I20260929 11:36:50.203370 17356 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:50.205150 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.199865 17392 raft_consensus.cc:2379] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:50.209537 17515 tablet_bootstrap.cc:654] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:50.192345 17383 raft_consensus.cc:1226] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.172642 17355 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:50.185657 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.194932 17985 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:50.202450 17172 debug-util.cc:398] Leaking SignalData structure 0x7b080013c880 after lost signal to thread 17268
I20260929 11:36:50.200460 18010 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:50.210958 17814 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.210732 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.200214 17991 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.216475 17994 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:50.233269 17971 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.223598 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.236418 17234 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.228976 17944 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:50.235001 17924 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:50.223330 17996 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.249470 17384 raft_consensus.cc:1226] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.251691 18006 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:36:50.309088 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 146301us
I20260929 11:36:50.313138 17460 raft_consensus.cc:2379] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:50.313359 18006 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:50.310086 17924 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.235653 18002 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.229893 18010 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:50.315899 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 112603us
I20260929 11:36:50.308405 17462 raft_consensus.cc:1226] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.273942 17208 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:50.307323 18013 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:36:50.326143 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800374560 after lost signal to thread 17342
I20260929 11:36:50.386873 17356 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:50.325614 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 132) took 1447 ms. Trace:
I20260929 11:36:50.326458 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:50.319099 18006 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.324082 17234 raft_consensus.cc:2454] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:50.305646 17957 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:50.327075 17973 consensus_meta.cc:287] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.532s user 0.007s sys 0.005s
I20260929 11:36:50.325804 17458 raft_consensus.cc:1226] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.330729 17962 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:50.397421 17464 rpcz_store.cc:276] 0929 11:36:48.878612 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.325327 (+446715us) service_pool.cc:227] Handling call
0929 11:36:50.324679 (+999352us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b580004c898. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:50.324945 (+ 266us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:50.325189 (+ 244us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:50.325230 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:50.325294 (+ 64us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:50.325340 (+ 46us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:50.325417 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:50.325539 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8143744}
I20260929 11:36:50.421209 17511 tablet_bootstrap.cc:492] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:50.421774 17511 ts_tablet_manager.cc:1397] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.571s user 0.047s sys 0.046s
I20260929 11:36:50.422580 17948 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:50.325600 18002 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:50.424618 17814 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.425700 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:50.323314 17924 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:50.320111 17991 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:50.316924 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.431798 17431 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:50.433395 17431 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:50.433686 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.434685 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.434944 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.435920 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.436013 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.436830 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.437155 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.437336 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.437721 17318 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:50.437949 17315 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:50.438311 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.438884 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.438984 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.439429 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.440814 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.441881 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:50.442009 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.442483 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.442927 17312 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:50.443665 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.444664 17385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 107) took 1325 ms. Trace:
I20260929 11:36:50.444862 17389 raft_consensus.cc:1226] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.445070 17385 rpcz_store.cc:276] 0929 11:36:49.119171 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.830475 (+711304us) service_pool.cc:227] Handling call
0929 11:36:50.444459 (+613984us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b54004ca9d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:50.444588 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":184363264}
I20260929 11:36:50.446058 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 113) took 1131 ms. Trace:
I20260929 11:36:50.427743 17386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 119) took 1074 ms. Trace:
I20260929 11:36:50.446996 17386 rpcz_store.cc:276] 0929 11:36:49.353712 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.971726 (+618014us) service_pool.cc:227] Handling call
0929 11:36:50.082981 (+111255us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:50.158209 (+ 75228us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:50.399000 (+240791us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400331b50. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:50.414732 (+ 15732us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":242790784}
I20260929 11:36:50.385206 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.448344 17138 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41934 (request call id 60) took 3454 ms. Trace:
I20260929 11:36:50.448685 17138 rpcz_store.cc:276] 0929 11:36:46.994410 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:46.995657 (+ 1247us) service_pool.cc:227] Handling call
0929 11:36:48.625252 (+1629595us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54002341d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819af0 00007f79b989cf2a 00007f79bf7eed6c 00007f79bf8e8c3e 00007f79bdbfafb4 00007f79bdbfaf42 00007f79bdbfae71 00007f79bdbfadec 00007f79bdbfa0a2 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:50.448260 (+1823008us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1160850,"reported_tablets":1,"spinlock_wait_cycles":43102464}
W20260929 11:36:50.451551 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:50.451658 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.452754 17236 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.389407 17466 raft_consensus.cc:1226] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.460569 17283 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:50.324083 17461 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
W20260929 11:36:50.397394 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800355900 after lost signal to thread 17343
W20260929 11:36:50.389281 17429 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.221.194:35795 timed out after 1.502s (SENT) [suppressed 144 similar messages]
I20260929 11:36:50.408730 17996 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:50.394739 18013 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:50.409052 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.409912 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.405973 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.402364 17971 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:50.482933 17971 raft_consensus.cc:686] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:50.478803 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.399009 17356 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:50.323963 17355 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:50.427238 17511 raft_consensus.cc:348] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:50.485270 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 86296.8us
I20260929 11:36:50.485366 17511 raft_consensus.cc:374] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:50.485908 17511 raft_consensus.cc:729] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:50.406832 17973 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:50.404201 17967 consensus_meta.cc:287] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.504s user 0.011s sys 0.000s
I20260929 11:36:50.446568 17385 raft_consensus.cc:1226] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.320832 17953 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.459033 17431 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:50.488350 17457 raft_consensus.cc:1226] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
W20260929 11:36:50.497222 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 91390.9us
W20260929 11:36:50.500079 17172 debug-util.cc:398] Leaking SignalData structure 0x7b08002053e0 after lost signal to thread 17416
I20260929 11:36:50.404105 17950 raft_consensus.cc:2726] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:36:50.464936 17283 leader_election.cc:341] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:50.319970 17997 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:50.401479 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 158461us
I20260929 11:36:50.440025 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.464025 18002 raft_consensus.cc:2781] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:50.466001 17991 raft_consensus.cc:2726] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.483832 17971 consensus_queue.cc:237] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:50.476473 18013 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.411681 18005 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:50.468068 17924 raft_consensus.cc:2726] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.486833 17511 consensus_queue.cc:260] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.325389 18003 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.489373 18014 raft_consensus.cc:2726] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.537660 17236 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:50.539390 17235 raft_consensus.cc:1226] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
W20260929 11:36:49.831295 17513 ts_tablet_manager.cc:1462] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: Trace:
0929 11:36:39.070632 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:39.101287 (+ 30655us) service_pool.cc:227] Handling call
0929 11:36:39.102999 (+ 1712us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0929 11:36:39.103087 (+ 88us) ts_tablet_manager.cc:676] Creating new metadata...
0929 11:36:39.363905 (+260818us) tablet_metadata.cc:641] Metadata flushed
0929 11:36:39.900205 (+536300us) tablet_replica.cc:205] Creating consensus instance
0929 11:36:39.950830 (+ 50625us) inbound_call.cc:173] Queueing success response
0929 11:36:46.813708 (+6862878us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0929 11:36:47.498309 (+684601us) ts_tablet_manager.cc:1429] Starting tablet replica
0929 11:36:49.780656 (+2282347us) tablet_replica.cc:259] Starting instrumentation
0929 11:36:49.785809 (+ 5153us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":2964,"tablet-open.queue_time_us":6871321}
I20260929 11:36:50.491166 17962 raft_consensus.cc:2726] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.501696 17996 raft_consensus.cc:2726] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.491671 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 114) took 1176 ms. Trace:
I20260929 11:36:50.492726 17243 raft_consensus.cc:1226] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.478479 17309 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.502128 17967 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.478739 17384 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.540301 17235 raft_consensus.cc:1226] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.540689 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:50.551710 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 71) took 1305 ms (client timeout 1714 ms). Trace:
I20260929 11:36:50.442205 17952 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.446408 17389 rpcz_store.cc:276] 0929 11:36:49.314591 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.894912 (+580321us) service_pool.cc:227] Handling call
0929 11:36:50.444675 (+549763us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:50.445273 (+ 598us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:50.445871 (+ 598us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54004ca9d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:50.446007 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1263577344}
W20260929 11:36:50.552083 17388 rpcz_store.cc:269] 0929 11:36:49.246259 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.248614 (+ 2355us) service_pool.cc:227] Handling call
0929 11:36:50.540539 (+1291925us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:50.551631 (+ 11092us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3084672}
I20260929 11:36:50.494587 17957 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.329674 18011 raft_consensus.cc:2726] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:36:50.541246 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 103) took 1423 ms (client timeout 1848 ms). Trace:
W20260929 11:36:50.553408 17392 rpcz_store.cc:269] 0929 11:36:49.117777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.835218 (+717441us) service_pool.cc:227] Handling call
0929 11:36:50.541050 (+705832us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54000b72d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:50.541190 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":742866304}
I20260929 11:36:50.474869 18012 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:50.491818 17983 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:50.492889 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 169010us
I20260929 11:36:50.513643 17356 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:50.516412 17390 raft_consensus.cc:1226] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.570689 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:50.542966 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 121) took 1098 ms. Trace:
I20260929 11:36:50.521050 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.524633 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:50.526031 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.526714 18005 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.529434 17973 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.531806 17463 raft_consensus.cc:1226] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.524794 17141 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41956 (request call id 65) took 3779 ms. Trace:
I20260929 11:36:50.581409 17141 rpcz_store.cc:276] 0929 11:36:46.745208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:46.761487 (+ 16279us) service_pool.cc:227] Handling call
0929 11:36:50.524736 (+3763249us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1711819,"reported_tablets":1}
I20260929 11:36:50.498785 17814 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:50.512470 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.511997 17950 consensus_queue.cc:1046] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260929 11:36:50.500569 18019 consensus_queue.cc:1046] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260929 11:36:50.533914 18016 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:50.514909 18002 raft_consensus.cc:686] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:50.536044 18003 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.546298 17511 ts_tablet_manager.cc:1428] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.124s user 0.007s sys 0.001s
I20260929 11:36:50.597268 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:50.597452 17985 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.598589 17511 tablet_bootstrap.cc:492] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:50.498919 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.600666 17985 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:50.601202 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.601681 18013 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.553877 17924 consensus_queue.cc:1046] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:50.557214 17242 raft_consensus.cc:1226] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.574928 18011 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:50.560519 18012 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.603812 18011 raft_consensus.cc:686] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:50.547832 17513 tablet_bootstrap.cc:492] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:50.604692 18011 consensus_queue.cc:237] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.549041 17967 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.606101 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.606899 17283 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:50.543694 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:50.547971 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.601292 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.609059 17238 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 0.
I20260929 11:36:50.609028 18013 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.609917 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.545792 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.567185 17979 consensus_queue.cc:1046] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260929 11:36:50.610241 17140 catalog_manager.cc:5495] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:50.520805 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:50.572408 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 58822.1us
I20260929 11:36:50.571382 17243 rpcz_store.cc:276] 0929 11:36:49.444870 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.446348 (+ 1478us) service_pool.cc:227] Handling call
0929 11:36:50.474288 (+1027940us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:50.488582 (+ 14294us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:50.542695 (+ 54113us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:50.542891 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3476352}
I20260929 11:36:50.546660 17208 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:50.576987 17431 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:50.579727 18005 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.579079 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.626344 17457 raft_consensus.cc:2379] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:50.626706 18001 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:50.592852 18019 raft_consensus.cc:3032] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.593020 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.593686 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:50.627255 18019 raft_consensus.cc:729] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:50.628126 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.628149 18019 consensus_queue.cc:260] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.629370 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.629927 18019 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.630012 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.594274 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:50.594702 17950 raft_consensus.cc:3032] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.594744 18016 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.595933 17952 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:50.542544 17387 rpcz_store.cc:276] 0929 11:36:49.314892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.898117 (+583225us) service_pool.cc:227] Handling call
0929 11:36:49.974421 (+ 76304us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:49.974996 (+ 575us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:50.491399 (+516403us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b54003dac50. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:50.491598 (+ 199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":174778624}
I20260929 11:36:50.562146 18010 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:50.596839 18002 consensus_queue.cc:237] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.598587 17317 raft_consensus.cc:1226] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.602618 17997 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:50.603549 17924 raft_consensus.cc:3032] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.541646 17383 raft_consensus.cc:1226] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:50.656364 18010 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:50.563593 17515 tablet_bootstrap.cc:492] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:50.657567 17515 ts_tablet_manager.cc:1397] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.705s user 0.019s sys 0.035s
W20260929 11:36:50.566843 17172 debug-util.cc:398] Leaking SignalData structure 0x7b08001089a0 after lost signal to thread 17490
I20260929 11:36:50.610042 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.568607 17355 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:50.570860 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 115) took 1246 ms. Trace:
I20260929 11:36:50.660920 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.661120 17390 rpcz_store.cc:276] 0929 11:36:49.324611 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:49.935021 (+610410us) service_pool.cc:227] Handling call
0929 11:36:49.942261 (+ 7240us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:50.569624 (+627363us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:50.570610 (+ 986us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54004aae54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:50.570799 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1315259136}
I20260929 11:36:50.662245 18018 raft_consensus.cc:2781] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.662212 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.662636 17513 tablet_bootstrap.cc:654] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:50.615442 17140 catalog_manager.cc:5495] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:50.664595 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 124) took 1046 ms. Trace:
I20260929 11:36:50.665023 17383 rpcz_store.cc:276] 0929 11:36:49.617781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:50.238423 (+620642us) service_pool.cc:227] Handling call
0929 11:36:50.541449 (+303026us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:50.656715 (+115266us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:50.664381 (+ 7666us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000b72d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:50.664539 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":545668864}
I20260929 11:36:50.665673 17988 raft_consensus.cc:3032] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.605225 18012 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:36:50.576030 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 186741us
I20260929 11:36:50.593822 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:50.619824 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.620074 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:50.668697 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800217100 after lost signal to thread 17637
W20260929 11:36:50.669245 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800047860 after lost signal to thread 17658
I20260929 11:36:50.623373 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.624396 17511 tablet_bootstrap.cc:654] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
W20260929 11:36:50.669623 17172 debug-util.cc:398] Leaking SignalData structure 0x7b08002e10e0 after lost signal to thread 17781
W20260929 11:36:50.669859 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800290d20 after lost signal to thread 17807
I20260929 11:36:50.669932 17463 raft_consensus.cc:2379] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
W20260929 11:36:50.670153 17172 debug-util.cc:398] Leaking SignalData structure 0x7b080033fc80 after lost signal to thread 17822
I20260929 11:36:50.670436 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.660230 17316 raft_consensus.cc:2379] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:50.672662 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:50.623296 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.673548 17240 raft_consensus.cc:2379] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:50.673651 17460 raft_consensus.cc:2379] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:50.625438 17996 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
W20260929 11:36:50.624748 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 47980.5us
I20260929 11:36:50.674480 17996 raft_consensus.cc:686] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:50.674937 17431 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:50.675516 18001 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:50.675410 17996 consensus_queue.cc:237] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.676029 18001 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.676286 17515 raft_consensus.cc:348] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.662720 18018 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:50.676977 17515 raft_consensus.cc:374] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:50.677114 18018 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.677301 17515 raft_consensus.cc:729] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:50.592571 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.593904 17942 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:50.630514 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:50.635696 17985 raft_consensus.cc:2726] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.638154 17983 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:50.624470 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.602646 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.649243 17924 raft_consensus.cc:729] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:50.650015 17953 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.639117 17814 consensus_queue.cc:1046] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260929 11:36:50.651619 18014 consensus_queue.cc:1046] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:50.677888 17429 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:50.699172 17814 raft_consensus.cc:3032] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.699375 18014 raft_consensus.cc:3032] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.699553 17814 raft_consensus.cc:729] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:50.699826 18014 raft_consensus.cc:729] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:50.652201 18013 consensus_queue.cc:1046] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:50.699250 17990 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.687722 17997 raft_consensus.cc:2781] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:50.700881 18013 raft_consensus.cc:3032] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.701113 17997 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:50.701285 18013 raft_consensus.cc:729] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:50.701545 17997 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.702085 18013 consensus_queue.cc:260] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.703040 17990 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:50.703414 18013 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.703769 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.704058 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:50.704586 17457 raft_consensus.cc:2379] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:50.634994 17950 raft_consensus.cc:729] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:50.697238 18006 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.653950 17979 consensus_queue.cc:1046] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:50.656919 18010 raft_consensus.cc:686] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:50.703428 17990 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.705812 17979 raft_consensus.cc:3032] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.706184 17979 raft_consensus.cc:729] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:50.705946 18010 consensus_queue.cc:237] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:50.706925 17979 consensus_queue.cc:260] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.666221 17988 raft_consensus.cc:729] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:50.622001 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:36:50.660924 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 92414.1us
I20260929 11:36:50.717625 17355 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:50.628894 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:50.678025 17515 consensus_queue.cc:260] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.720470 17355 leader_election.cc:302] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
W20260929 11:36:50.636482 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 89903.7us
W20260929 11:36:50.670468 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800137f40 after lost signal to thread 17872
W20260929 11:36:50.678401 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 44747.5us
I20260929 11:36:50.696030 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:50.696025 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.653075 18016 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:50.708680 17310 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:50.690189 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.708099 17979 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.726195 17515 ts_tablet_manager.cc:1428] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260929 11:36:50.740496 18017 raft_consensus.cc:2726] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.719491 17429 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:50.716779 17814 consensus_queue.cc:260] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.731848 17466 raft_consensus.cc:2379] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:50.732525 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:50.733644 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:50.735092 17950 consensus_queue.cc:260] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.786412 17950 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.786468 17995 raft_consensus.cc:2726] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.735776 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:50.736392 17924 consensus_queue.cc:260] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:50.728646 17172 debug-util.cc:398] Leaking SignalData structure 0x7b080033c080 after lost signal to thread 17882
I20260929 11:36:50.776423 17511 tablet_bootstrap.cc:492] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:50.729696 17988 consensus_queue.cc:260] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.780308 17515 tablet_bootstrap.cc:492] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:50.727659 17962 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.742807 18001 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:50.772445 17942 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:50.784242 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 64839.9us
I20260929 11:36:50.797075 17962 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:50.797935 17962 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.798700 17429 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:50.733692 18006 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:50.740031 17990 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:50.796392 17172 debug-util.cc:398] Leaking SignalData structure 0x7b080025ad60 after lost signal to thread 17900
I20260929 11:36:50.782410 18027 consensus_queue.cc:1046] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260929 11:36:50.804816 18027 raft_consensus.cc:3032] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.805160 18027 raft_consensus.cc:729] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:50.806412 17513 tablet_bootstrap.cc:492] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:50.805948 18027 consensus_queue.cc:260] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:50.806823 17513 ts_tablet_manager.cc:1397] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.259s user 0.015s sys 0.000s
I20260929 11:36:50.807327 18027 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.791169 18032 consensus_queue.cc:1046] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:50.808877 18032 raft_consensus.cc:3032] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.808996 17513 raft_consensus.cc:348] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.772504 17983 consensus_queue.cc:1046] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260929 11:36:50.809618 17513 raft_consensus.cc:374] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:50.792058 18026 consensus_queue.cc:1035] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:50.809897 17513 raft_consensus.cc:729] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:50.795169 17511 ts_tablet_manager.cc:1397] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.197s user 0.011s sys 0.004s
I20260929 11:36:50.810107 17983 raft_consensus.cc:3032] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:50.810496 17983 raft_consensus.cc:729] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:50.810695 17513 consensus_queue.cc:260] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.811261 17983 consensus_queue.cc:260] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.787194 17814 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.794466 17240 raft_consensus.cc:2379] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 1: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:50.812429 17983 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:50.790551 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 68991.1us
I20260929 11:36:50.816519 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.802289 17462 raft_consensus.cc:2379] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:50.800120 17924 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.818753 17988 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.875236 17990 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:50.809209 18032 raft_consensus.cc:729] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:50.873680 17356 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:50.842221 17513 ts_tablet_manager.cc:1428] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.035s user 0.009s sys 0.005s
I20260929 11:36:50.803603 17995 raft_consensus.cc:2726] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.877993 18013 raft_consensus.cc:3037] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.844596 17355 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:50.878377 17357 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:50.879119 17355 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:50.845628 17511 raft_consensus.cc:348] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:50.880101 17511 raft_consensus.cc:374] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:50.877868 18032 consensus_queue.cc:260] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.880846 17953 raft_consensus.cc:2726] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.881058 18032 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.849649 17237 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.855732 17429 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:50.858985 18012 consensus_queue.cc:1035] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:50.859866 17515 tablet_bootstrap.cc:654] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:50.880419 17511 raft_consensus.cc:729] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:50.880694 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.853220 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:50.820016 17172 debug-util.cc:398] Leaking SignalData structure 0x7b080030fbe0 after lost signal to thread 17906
I20260929 11:36:50.861030 17997 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:50.745496 18014 consensus_queue.cc:260] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:50.882349 17355 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:50.894002 17513 tablet_bootstrap.cc:492] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a: Bootstrap starting.
I20260929 11:36:50.894671 17355 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:50.881474 17953 raft_consensus.cc:2726] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:50.884924 17511 consensus_queue.cc:260] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:50.898904 17463 raft_consensus.cc:2379] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:50.899022 18018 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:50.899679 17997 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:50.903023 17355 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:50.904853 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:50.887660 18009 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:36:50.891031 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800137c40 after lost signal to thread 17908
I20260929 11:36:50.907876 17240 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:50.905783 17985 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:50.908186 17814 consensus_queue.cc:1035] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260929 11:36:50.908424 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 66802.4us
W20260929 11:36:50.905720 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 121563us
I20260929 11:36:50.902375 17995 raft_consensus.cc:2726] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.925130 17355 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:50.906810 17282 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:50.927323 17511 ts_tablet_manager.cc:1428] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.117s user 0.008s sys 0.000s
W20260929 11:36:50.912806 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800130280 after lost signal to thread 17911
I20260929 11:36:50.905583 18006 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.934461 17429 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:50.935289 17511 tablet_bootstrap.cc:492] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:50.909579 18004 raft_consensus.cc:2726] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.912700 18016 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.928360 18009 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:50.942909 17282 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:50.939680 17172 debug-util.cc:398] Leaking SignalData structure 0x7b0800374900 after lost signal to thread 17913
I20260929 11:36:50.931481 17988 raft_consensus.cc:2726] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.941095 18014 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.938139 18006 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:50.954612 17282 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:50.925407 17985 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:50.949368 17172 debug-util.cc:398] Leaking SignalData structure 0x7b080031f360 after lost signal to thread 17917
I20260929 11:36:50.942391 18016 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:50.947995 18001 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:50.947954 18009 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.949635 18004 raft_consensus.cc:2726] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:50.948839 17814 consensus_queue.cc:1046] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260929 11:36:50.972074 18040 consensus_queue.cc:1046] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260929 11:36:50.960942 18006 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.946341 18026 consensus_queue.cc:1046] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260929 11:36:50.966998 17172 debug-util.cc:398] Leaking SignalData structure 0x7b080034ffe0 after lost signal to thread 17920
W20260929 11:36:51.007702 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 53179.7us
I20260929 11:36:51.010744 17282 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:50.966913 18016 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:50.966956 18001 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:50.971292 17990 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:50.969939 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.006430 18018 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:50.962019 17429 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:51.016251 18001 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.031213 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.017711 18039 consensus_queue.cc:1046] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260929 11:36:51.039366 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:51.043087 17513 tablet_bootstrap.cc:654] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:51.053287 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:51.054061 17391 raft_consensus.cc:2454] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:51.047696 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.054505 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.059377 17431 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:51.054999 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.019704 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.019157 17988 raft_consensus.cc:2726] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.065371 17240 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:51.033393 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.073240 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.073608 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.075922 17385 raft_consensus.cc:2379] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:51.073295 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.076936 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:51.078187 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.078359 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.079416 17388 raft_consensus.cc:2379] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:51.081626 17384 raft_consensus.cc:1226] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.082041 17985 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:51.082283 17388 raft_consensus.cc:1226] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.083076 17814 raft_consensus.cc:3032] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.083444 17814 raft_consensus.cc:729] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.083320 17952 consensus_queue.cc:1046] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:51.083578 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.083959 18013 raft_consensus.cc:2726] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:51.084586 17952 raft_consensus.cc:3032] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.084481 17814 consensus_queue.cc:260] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.085148 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:51.085742 17814 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.085798 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.089376 18009 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.090348 17355 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.091395 18009 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:51.085000 17952 raft_consensus.cc:729] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:51.091790 17355 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.092264 17997 raft_consensus.cc:2781] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:51.092736 17997 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260929 11:36:51.066315 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 104404us
I20260929 11:36:51.021845 17990 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:51.092391 17952 consensus_queue.cc:260] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.091508 17511 tablet_bootstrap.cc:654] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:51.048645 17994 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:51.084810 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:36:51.111202 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 100537us
I20260929 11:36:51.095202 17355 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.099711 17431 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:51.091951 18009 raft_consensus.cc:2726] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.143889 17282 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.097018 17392 raft_consensus.cc:1226] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.093084 17997 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.066028 18043 raft_consensus.cc:2726] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:36:51.145782 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 46193.2us
I20260929 11:36:51.152158 17985 raft_consensus.cc:2781] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:51.152649 17389 raft_consensus.cc:2454] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:51.155828 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.097304 18013 raft_consensus.cc:2726] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260929 11:36:51.166386 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 71285.7us
I20260929 11:36:51.080567 18041 consensus_queue.cc:1035] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.208s
I20260929 11:36:51.146422 18004 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:51.145351 17994 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:51.156984 17990 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:51.157125 18002 raft_consensus.cc:2781] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:51.170014 17957 raft_consensus.cc:2726] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.169320 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:51.181473 17985 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:51.207195 18004 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.207382 17994 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.201851 18045 raft_consensus.cc:2726] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.219219 17985 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:51.230185 17282 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:51.220216 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:51.245774 17429 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.261758 17952 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.257014 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:51.262663 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 72987.1us
I20260929 11:36:51.297640 18004 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:51.304622 17515 tablet_bootstrap.cc:492] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:51.388056 17515 ts_tablet_manager.cc:1397] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.608s user 0.023s sys 0.022s
I20260929 11:36:51.306643 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:51.306670 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:51.311729 18027 consensus_meta.cc:287] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.504s user 0.007s sys 0.004s
I20260929 11:36:51.313238 17388 raft_consensus.cc:1226] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.317772 17392 raft_consensus.cc:1261] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260929 11:36:51.319890 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 357844us
W20260929 11:36:51.321879 17962 consensus_meta.cc:287] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.524s user 0.006s sys 0.003s
I20260929 11:36:51.323809 18006 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.389473 18053 raft_consensus.cc:2726] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.396149 17384 raft_consensus.cc:1226] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.397377 18006 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:51.253999 18046 consensus_queue.cc:1046] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260929 11:36:51.398126 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:51.325162 17979 raft_consensus.cc:3032] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.399294 17979 raft_consensus.cc:729] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.400394 17241 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:51.400177 17979 consensus_queue.cc:260] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.393200 17995 raft_consensus.cc:2726] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.401388 17979 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.400961 17962 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:51.401854 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 179449us
I20260929 11:36:51.402628 17429 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.403715 17962 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:51.332649 18032 raft_consensus.cc:3032] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.404479 18032 raft_consensus.cc:729] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.333248 17317 raft_consensus.cc:2454] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:51.405282 18032 consensus_queue.cc:260] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.406698 18032 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.334412 17988 raft_consensus.cc:3032] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.407698 18057 consensus_queue.cc:1035] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:51.408128 17988 raft_consensus.cc:729] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.393692 18004 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:51.409071 17431 leader_election.cc:341] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:51.408944 17988 consensus_queue.cc:260] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.409449 18004 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:51.410221 17988 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.411463 18004 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:51.337785 17235 raft_consensus.cc:1261] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:51.337931 17973 consensus_queue.cc:1046] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:51.412948 17973 raft_consensus.cc:3032] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.337251 17208 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.413276 17973 raft_consensus.cc:729] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
W20260929 11:36:51.413908 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 76766us
I20260929 11:36:51.414068 17973 consensus_queue.cc:260] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:51.415412 17973 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.342341 17391 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.343050 17385 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.357899 18001 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:51.354305 18016 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.427676 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:51.428354 17235 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:51.428968 18016 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:51.375206 17997 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.430691 17997 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:51.377142 17950 consensus_meta.cc:287] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.590s user 0.012s sys 0.000s
I20260929 11:36:51.379400 17994 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:51.432592 17994 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:51.380923 17985 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:51.434250 17985 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:51.363873 17383 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.434993 18001 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:51.387135 17355 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.428115 17239 raft_consensus.cc:1226] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.436218 17462 raft_consensus.cc:1226] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.436493 17243 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.437621 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.438261 17386 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:51.441829 17392 raft_consensus.cc:1226] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.443419 17385 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.439813 17515 raft_consensus.cc:348] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.444837 17515 raft_consensus.cc:374] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260929 11:36:51.387089 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 157007us
I20260929 11:36:51.404735 18059 raft_consensus.cc:2726] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260929 11:36:51.446838 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 59832.8us
I20260929 11:36:51.447918 17355 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.444197 17387 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:51.452838 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:51.454345 18027 consensus_queue.cc:1046] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:51.455430 18027 raft_consensus.cc:3032] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.452433 17950 raft_consensus.cc:2726] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.367637 18044 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:51.419739 17357 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:51.385960 18002 raft_consensus.cc:686] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:51.416574 18005 raft_consensus.cc:2726] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:36:51.424345 18012 consensus_queue.cc:1035] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:51.424623 17967 consensus_queue.cc:1046] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:51.425263 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:51.425832 17241 raft_consensus.cc:1226] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.426280 18046 raft_consensus.cc:3032] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.445116 17515 raft_consensus.cc:729] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:51.445534 17282 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.455750 18027 raft_consensus.cc:729] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.457644 17355 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.416168 17513 tablet_bootstrap.cc:492] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a: No bootstrap required, opened a new log
I20260929 11:36:51.459679 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:51.461074 17462 raft_consensus.cc:1226] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.461230 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:51.461552 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:51.462954 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:51.463625 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:51.449569 17971 consensus_queue.cc:1046] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260929 11:36:51.461112 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:51.471330 17515 consensus_queue.cc:260] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.471848 17282 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.457425 17985 consensus_queue.cc:1046] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260929 11:36:51.472458 18041 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:51.473184 17513 ts_tablet_manager.cc:1397] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a: Time spent bootstrapping tablet: real 0.583s user 0.044s sys 0.048s
I20260929 11:36:51.474135 17355 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:51.474761 17962 raft_consensus.cc:2726] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.475124 17967 raft_consensus.cc:3032] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.450160 17995 consensus_queue.cc:1035] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260929 11:36:51.465658 18004 raft_consensus.cc:2726] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.478662 17242 raft_consensus.cc:2379] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:51.456607 18044 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.404103 17429 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.485517 17511 tablet_bootstrap.cc:492] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:51.485852 17282 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:51.486691 18010 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:51.505342 18044 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:51.507081 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 103059us
I20260929 11:36:51.507450 18001 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.508443 17429 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.489550 17463 raft_consensus.cc:1261] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260929 11:36:51.496024 17356 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:51.490695 17967 raft_consensus.cc:729] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:51.487601 17458 raft_consensus.cc:1226] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.496718 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.489434 17238 raft_consensus.cc:2379] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 1: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:51.490862 18016 raft_consensus.cc:2781] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:51.498045 17311 raft_consensus.cc:1261] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260929 11:36:51.497923 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.489646 18041 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:51.475219 18002 consensus_queue.cc:237] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:51.499042 18050 consensus_queue.cc:1046] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260929 11:36:51.500921 18051 raft_consensus.cc:2726] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.500810 17431 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
W20260929 11:36:51.555707 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 54976.6us
I20260929 11:36:51.504106 17511 ts_tablet_manager.cc:1397] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.573s user 0.014s sys 0.018s
I20260929 11:36:51.505452 18010 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:51.470911 18046 raft_consensus.cc:729] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.545476 17311 pending_rounds.cc:76] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: Aborting all ops after (but not including) 0
I20260929 11:36:51.506094 18012 consensus_queue.cc:1046] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:51.506989 17385 raft_consensus.cc:1226] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.511032 17282 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.493491 17240 raft_consensus.cc:1226] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.553190 18041 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.515259 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:51.519130 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:51.520699 17967 consensus_queue.cc:260] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.551575 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.502395 18027 consensus_queue.cc:260] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:51.552421 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.506214 17983 raft_consensus.cc:2726] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:51.563524 17355 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.564577 18066 consensus_queue.cc:1046] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260929 11:36:51.521323 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:51.534174 18016 raft_consensus.cc:686] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:51.554186 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.562440 17235 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
W20260929 11:36:51.583654 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 72684.2us
I20260929 11:36:51.514781 17995 raft_consensus.cc:2726] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.562407 17997 raft_consensus.cc:2781] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:51.558251 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:51.562244 17311 pending_rounds.cc:97] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260929 11:36:51.602984 17312 raft_consensus.cc:2379] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
W20260929 11:36:51.608700 17431 leader_election.cc:341] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:51.641413 17431 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.568276 17386 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:51.585708 17511 raft_consensus.cc:348] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.569193 18012 raft_consensus.cc:3032] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.607939 18013 raft_consensus.cc:2726] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.568504 18058 raft_consensus.cc:2726] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.604238 17515 ts_tablet_manager.cc:1428] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.216s user 0.037s sys 0.001s
I20260929 11:36:51.614360 18016 consensus_queue.cc:237] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.651247 17282 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:51.622215 17513 raft_consensus.cc:348] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.652535 17513 raft_consensus.cc:374] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:51.652817 17513 raft_consensus.cc:729] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Initialized, Role: FOLLOWER
I20260929 11:36:51.628423 17355 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.654531 17355 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
W20260929 11:36:51.582870 17429 leader_election.cc:341] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:51.642694 17431 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:51.608827 17971 consensus_queue.cc:1046] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260929 11:36:51.644948 17511 raft_consensus.cc:374] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:51.645536 17311 raft_consensus.cc:2866] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:36:51.643211 18050 consensus_queue.cc:1046] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260929 11:36:51.648063 17283 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.615302 17967 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.614880 18027 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.535951 17962 consensus_queue.cc:1035] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.114s
I20260929 11:36:51.653426 17513 consensus_queue.cc:260] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.605203 17985 raft_consensus.cc:2726] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.659726 17355 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.659373 18053 raft_consensus.cc:2726] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.660567 17429 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.649011 18006 raft_consensus.cc:2741] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260929 11:36:51.661126 17990 raft_consensus.cc:2781] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:51.687834 17950 consensus_queue.cc:1035] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260929 11:36:51.658027 18032 consensus_queue.cc:1046] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260929 11:36:51.648473 17997 raft_consensus.cc:686] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:51.667028 17283 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:51.649320 18012 raft_consensus.cc:729] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:51.645184 17995 raft_consensus.cc:2726] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:51.664361 18051 consensus_queue.cc:1046] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260929 11:36:51.668131 17983 raft_consensus.cc:2726] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.658504 18017 raft_consensus.cc:2726] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.661275 18013 raft_consensus.cc:2726] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.670217 17957 raft_consensus.cc:2726] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.670955 18010 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:51.664860 17971 consensus_queue.cc:1046] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260929 11:36:51.713832 17814 raft_consensus.cc:3032] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.672350 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:51.672899 17140 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41940 (request call id 60) took 4837 ms. Trace:
I20260929 11:36:51.714775 17458 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:51.708832 17985 raft_consensus.cc:2781] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:51.715101 18064 raft_consensus.cc:3032] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.715601 18064 raft_consensus.cc:729] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:51.715744 18010 raft_consensus.cc:3032] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.715860 17207 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:51.716226 18010 raft_consensus.cc:729] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:51.716446 18064 consensus_queue.cc:260] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:51.717062 18010 consensus_queue.cc:260] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.717680 18064 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.717329 17997 consensus_queue.cc:237] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:51.718590 18012 consensus_queue.cc:260] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:51.677865 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:51.681357 17282 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:51.643427 18046 consensus_queue.cc:260] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:51.665913 17515 tablet_bootstrap.cc:492] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:51.703245 17513 ts_tablet_manager.cc:1428] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a: Time spent starting tablet: real 0.215s user 0.006s sys 0.000s
I20260929 11:36:51.692662 18066 raft_consensus.cc:3032] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.698887 18059 raft_consensus.cc:2726] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:51.696556 17990 raft_consensus.cc:686] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
W20260929 11:36:51.698632 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 117715us
I20260929 11:36:51.714282 17814 raft_consensus.cc:729] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.720846 17985 raft_consensus.cc:686] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.714994 17140 rpcz_store.cc:276] 0929 11:36:46.835574 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:46.836425 (+ 851us) service_pool.cc:227] Handling call
0929 11:36:51.672816 (+4836391us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0929 11:36:50.788629 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0929 11:36:50.797623 (+ 8994us) write_op.cc:432] Acquiring schema lock in shared mode
0929 11:36:50.797661 (+ 38us) write_op.cc:435] Acquired schema lock
0929 11:36:50.797678 (+ 17us) tablet.cc:660] Decoding operations
0929 11:36:50.798076 (+ 398us) write_op.cc:620] Acquiring the partition lock for write op
0929 11:36:50.798126 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0929 11:36:50.798153 (+ 27us) tablet.cc:683] Acquiring locks for 2 operations
0929 11:36:50.798486 (+ 333us) tablet.cc:699] Row locks acquired
0929 11:36:50.798501 (+ 15us) write_op.cc:260] PREPARE: finished
0929 11:36:50.798645 (+ 144us) write_op.cc:270] Start()
0929 11:36:50.798748 (+ 103us) write_op.cc:276] Timestamp: P: 1790681810798604 usec, L: 0
0929 11:36:50.798770 (+ 22us) op_driver.cc:331] REPLICATION: starting
0929 11:36:50.799396 (+ 626us) log.cc:842] Serialized 934 byte log entry
0929 11:36:51.386462 (+587066us) op_driver.cc:444] REPLICATION: finished
0929 11:36:51.494620 (+108158us) write_op.cc:301] APPLY: starting
0929 11:36:51.494700 (+ 80us) tablet.cc:1365] starting BulkCheckPresence
0929 11:36:51.494809 (+ 109us) tablet.cc:1368] finished BulkCheckPresence
0929 11:36:51.494959 (+ 150us) tablet.cc:1370] starting ApplyRowOperation cycle
0929 11:36:51.495303 (+ 344us) tablet.cc:1381] finished ApplyRowOperation cycle
0929 11:36:51.495462 (+ 159us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0929 11:36:51.495503 (+ 41us) write_op.cc:312] APPLY: finished
0929 11:36:51.495690 (+ 187us) log.cc:842] Serialized 28 byte log entry
0929 11:36:51.495817 (+ 127us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:36:51.495894 (+ 77us) write_op.cc:454] Released schema lock
0929 11:36:51.495926 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0929 11:36:51.502674 (+ 6748us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:36:51.503467 (+ 793us) write_op.cc:454] Released schema lock
0929 11:36:51.671681 (+168214us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18001fa080. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b952382c 00007f79b694e9dc 00007f79bf785a39 00007f79b696b8bb 00007f79b6969cbf 00007f79b6969155 00007f79b9829a30 00007f79b982344d 00007f79b982278b
Metrics: {"mutex_wait_us":11808,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":101330,"apply.run_cpu_time_us":2112,"apply.run_wall_time_us":19975,"num_ops":2,"prepare.queue_time_us":109695,"prepare.run_cpu_time_us":64543,"prepare.run_wall_time_us":163456,"raft.queue_time_us":291940,"raft.run_cpu_time_us":12869,"raft.run_wall_time_us":98126,"replication_time_us":586299,"spinlock_wait_cycles":6412032,"thread_start_us":543646,"threads_started":4,"wal-append.queue_time_us":165213}]]}
I20260929 11:36:51.659746 17511 raft_consensus.cc:729] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
W20260929 11:36:51.724759 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 43636.6us
I20260929 11:36:51.731120 18046 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.747615 17282 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.732784 17988 raft_consensus.cc:2726] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.747576 17511 consensus_queue.cc:260] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.749387 17282 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:51.742712 18066 raft_consensus.cc:729] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
W20260929 11:36:51.741345 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 127561us
I20260929 11:36:51.748466 18069 raft_consensus.cc:2781] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:51.752732 17983 raft_consensus.cc:2726] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.751560 18012 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.753721 18032 raft_consensus.cc:2726] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.767311 17814 consensus_queue.cc:260] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.769285 17206 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.769793 17457 raft_consensus.cc:1226] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260929 11:36:51.770177 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:51.770466 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:51.780687 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.771157 17988 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:51.798977 17988 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.772549 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.801355 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.802234 17318 raft_consensus.cc:2379] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:51.803026 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.802814 17985 consensus_queue.cc:237] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:51.772835 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:51.774098 17466 raft_consensus.cc:1226] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.775262 17511 ts_tablet_manager.cc:1428] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.218s user 0.008s sys 0.007s
I20260929 11:36:51.806792 17988 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:51.807207 17511 tablet_bootstrap.cc:492] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:51.807852 18001 raft_consensus.cc:2726] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.774331 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.762462 18069 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:51.772187 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:51.780777 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.781214 17814 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.781548 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.781721 17990 consensus_queue.cc:237] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:51.782313 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:51.782574 17429 leader_election.cc:341] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:51.782786 18072 consensus_queue.cc:1035] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:51.784181 17973 raft_consensus.cc:2726] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.812790 17282 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:51.858197 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 45517.1us
I20260929 11:36:51.859038 17282 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:51.850380 17511 tablet_bootstrap.cc:654] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:51.861922 17282 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:51.853703 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 69935.1us
I20260929 11:36:51.822635 18069 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:51.851922 17310 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.824384 18027 consensus_queue.cc:1046] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260929 11:36:51.872867 17316 raft_consensus.cc:2379] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:51.824600 17208 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.870147 17988 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:51.872913 18016 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:51.869910 17312 raft_consensus.cc:2379] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:51.868037 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:51.868994 18050 raft_consensus.cc:3032] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:51.874369 18040 raft_consensus.cc:2726] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.873450 18032 raft_consensus.cc:2726] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260929 11:36:51.786033 18066 consensus_queue.cc:260] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:51.873955 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 94207.3us
W20260929 11:36:51.882647 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 95485.9us
I20260929 11:36:51.875273 18051 consensus_queue.cc:1046] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 2, Time since last communication: 0.023s
I20260929 11:36:51.897774 18050 raft_consensus.cc:729] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:51.909387 18050 consensus_queue.cc:260] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:51.910573 17429 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.912086 17429 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.912941 18001 raft_consensus.cc:2726] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.912808 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.913600 17310 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.914520 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.914418 18002 consensus_queue.cc:1046] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:51.915215 17310 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.905434 18041 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:51.918685 17283 leader_election.cc:341] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:51.919309 17317 raft_consensus.cc:1226] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:51.919605 17318 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.919699 18041 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:51.922254 17515 tablet_bootstrap.cc:654] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:51.925530 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.928710 18010 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.929251 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.930101 17316 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:51.931033 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.927089 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:51.916105 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.898378 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.934038 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.913605 18001 raft_consensus.cc:2726] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.897579 18016 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:51.924980 18072 raft_consensus.cc:2726] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.916111 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.899089 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:51.935320 17315 raft_consensus.cc:1261] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:51.934748 17312 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.936553 18016 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:51.932144 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.915663 17997 raft_consensus.cc:3032] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
W20260929 11:36:51.941326 17283 leader_election.cc:341] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:51.944746 17283 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:51.920583 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 123767us
I20260929 11:36:51.958170 17208 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.964989 18078 raft_consensus.cc:2726] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:51.942813 18066 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:51.941905 17971 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:51.962416 18053 raft_consensus.cc:2726] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:51.942188 17997 raft_consensus.cc:729] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:51.982350 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:51.983247 17206 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:51.991369 17313 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:51.993484 18069 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:51.941535 17316 raft_consensus.cc:2454] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:51.961882 17429 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.946460 18051 consensus_queue.cc:1225] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer 26cd298fcaa34c9f93d8793e64f0e863 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260929 11:36:51.965945 17957 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:51.969273 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:52.000028 17312 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:52.009719 17511 tablet_bootstrap.cc:492] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:52.002686 17957 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.004531 18001 raft_consensus.cc:2726] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.003091 18078 raft_consensus.cc:2726] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.017261 18013 consensus_queue.cc:1046] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:52.035728 17283 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:51.981482 17971 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.030810 18069 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:52.047540 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.047766 17355 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:52.047888 17971 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:52.031723 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 93465us
I20260929 11:36:52.048480 17312 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:52.049714 17429 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.051759 17355 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:52.032075 17206 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:52.031805 18081 log.cc:924] Time spent T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260929 11:36:52.032460 17997 consensus_queue.cc:260] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:52.029471 17511 ts_tablet_manager.cc:1397] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.222s user 0.012s sys 0.015s
I20260929 11:36:52.039361 18051 raft_consensus.cc:2726] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.037109 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:52.064039 17462 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:36:52.064767 18016 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:52.070464 18016 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:52.070863 18016 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:52.041669 18044 raft_consensus.cc:3032] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:52.072878 18044 raft_consensus.cc:729] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:52.073203 17462 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:52.073743 18044 consensus_queue.cc:260] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:52.074436 17207 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:52.075023 18017 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.075169 18044 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.075580 18017 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.042484 17979 raft_consensus.cc:3032] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:52.078372 17979 raft_consensus.cc:729] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:52.079332 17979 consensus_queue.cc:260] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:52.080071 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.080704 17979 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.081436 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.082233 17313 raft_consensus.cc:2379] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 1: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:52.082968 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.075955 17971 raft_consensus.cc:2781] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:52.085220 17971 raft_consensus.cc:686] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:52.086200 18050 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.086129 17971 consensus_queue.cc:237] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.043901 18013 raft_consensus.cc:3032] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:52.015671 17988 raft_consensus.cc:2726] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:52.046386 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.054304 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:52.058143 17309 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:52.059424 18058 raft_consensus.cc:2781] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:52.059535 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.107715 18058 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:52.108095 18058 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:52.108604 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.110491 17310 raft_consensus.cc:1261] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:52.022998 17208 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:52.114253 17310 raft_consensus.cc:1226] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:52.114943 18012 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:52.115455 18012 raft_consensus.cc:686] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:52.116287 18012 consensus_queue.cc:237] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.052533 18002 raft_consensus.cc:2726] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.066394 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.122056 17311 raft_consensus.cc:1261] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:52.066638 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.123942 17318 raft_consensus.cc:2379] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
W20260929 11:36:52.114609 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 113150us
I20260929 11:36:52.067118 17206 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:52.067258 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.067978 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.069443 17466 raft_consensus.cc:1226] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:52.042776 17957 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:52.089447 17461 raft_consensus.cc:1226] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:52.129583 17208 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:52.084008 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.129653 17312 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:52.093247 18059 consensus_queue.cc:1035] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:52.090943 18013 raft_consensus.cc:729] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:52.096402 17463 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:52.097812 17997 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.094432 18005 raft_consensus.cc:3032] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:52.099011 18017 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:52.101401 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.101754 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.139428 17317 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:52.139781 17316 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:52.140621 18078 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.076756 18010 raft_consensus.cc:2741] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260929 11:36:52.141124 17355 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:52.141975 18017 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:52.142422 18017 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:52.142824 18017 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:52.103502 17429 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:52.103922 17515 tablet_bootstrap.cc:492] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:52.146253 17515 ts_tablet_manager.cc:1397] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.480s user 0.014s sys 0.020s
I20260929 11:36:52.104741 17511 raft_consensus.cc:348] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.027683 17137 catalog_manager.cc:5495] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 1 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:52.124665 17309 raft_consensus.cc:1261] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:52.147503 17137 catalog_manager.cc:5495] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 1 to 2, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:52.149458 17137 catalog_manager.cc:5495] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 1 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:52.146909 17511 raft_consensus.cc:374] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:52.150894 17511 raft_consensus.cc:729] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:52.151443 17511 consensus_queue.cc:260] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.137373 18069 consensus_queue.cc:1046] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260929 11:36:52.153417 18013 consensus_queue.cc:260] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:52.154788 18013 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.137504 18066 raft_consensus.cc:2781] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:52.133975 18005 raft_consensus.cc:729] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:52.160167 17463 raft_consensus.cc:1261] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:52.163323 17511 ts_tablet_manager.cc:1428] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.100s user 0.006s sys 0.000s
I20260929 11:36:52.164194 17208 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:52.164827 17511 tablet_bootstrap.cc:492] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af: Bootstrap starting.
I20260929 11:36:52.157675 18059 raft_consensus.cc:2726] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.143671 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.128798 18058 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:52.169628 18080 raft_consensus.cc:2781] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:52.171209 18033 consensus_queue.cc:1035] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260929 11:36:52.171938 18080 raft_consensus.cc:686] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:52.172952 17234 raft_consensus.cc:3037] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:52.172776 18080 consensus_queue.cc:237] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.169835 18066 raft_consensus.cc:686] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:52.173360 17515 raft_consensus.cc:348] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.174160 17515 raft_consensus.cc:374] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:52.174445 17515 raft_consensus.cc:729] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:52.175550 17515 consensus_queue.cc:260] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:52.156437 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 89419.4us
I20260929 11:36:52.177073 18066 consensus_queue.cc:237] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.169947 18069 consensus_queue.cc:1046] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260929 11:36:52.181233 18069 raft_consensus.cc:3032] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:52.181559 18050 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:52.160665 18016 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.181595 18069 raft_consensus.cc:729] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:52.185395 17515 ts_tablet_manager.cc:1428] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260929 11:36:52.184078 17953 consensus_queue.cc:1035] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260929 11:36:52.187947 18058 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:52.177073 17979 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
W20260929 11:36:52.167902 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 64478.2us
I20260929 11:36:52.183632 17988 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:52.212306 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:52.215003 17463 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:52.220522 17388 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:52.183377 18050 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.209062 17953 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.225190 17953 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.208623 18027 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:52.218506 17988 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.237282 17515 tablet_bootstrap.cc:492] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:52.234230 17463 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:52.232604 17953 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:52.239081 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.238674 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.238827 17356 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:52.239292 17990 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:52.240571 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.240671 17990 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.241582 17309 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:52.242944 17990 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:52.206094 18064 consensus_queue.cc:1046] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260929 11:36:52.245110 18033 raft_consensus.cc:2781] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:52.245278 18064 raft_consensus.cc:3032] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:52.245683 18033 raft_consensus.cc:686] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:52.245850 18064 raft_consensus.cc:729] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
W20260929 11:36:52.249118 17357 leader_election.cc:341] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:52.255406 17429 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.206781 18069 consensus_queue.cc:260] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.256683 18002 raft_consensus.cc:2726] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.257308 18069 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.257356 17429 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.246541 18033 consensus_queue.cc:237] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:52.259634 18059 raft_consensus.cc:2726] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.259922 17994 consensus_queue.cc:1035] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:52.260284 18059 consensus_queue.cc:1046] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:52.231693 18027 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.261925 18001 raft_consensus.cc:3032] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:52.261790 18059 consensus_queue.cc:1035] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:52.262322 18001 raft_consensus.cc:729] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:52.262756 18027 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:52.261729 17429 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:52.263134 18001 consensus_queue.cc:260] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:52.263775 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.264217 17990 raft_consensus.cc:2726] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.264657 17388 raft_consensus.cc:2379] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:52.212411 17206 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.265302 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.265992 17317 raft_consensus.cc:2454] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
W20260929 11:36:52.266100 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 65353.3us
I20260929 11:36:52.266031 17990 consensus_queue.cc:1035] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:52.267048 17206 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:52.267450 17355 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:52.268160 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.268555 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.268908 17990 consensus_queue.cc:1035] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:52.269325 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.268563 18058 raft_consensus.cc:2781] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:52.269961 18058 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:52.270117 17388 raft_consensus.cc:2379] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:52.270336 18058 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:52.271001 17429 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:52.273821 18059 raft_consensus.cc:2726] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.273872 18072 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:52.275511 17431 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.286340 17994 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:52.287019 17994 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.289163 17994 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:52.289942 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.290103 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.290653 17384 raft_consensus.cc:2379] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:52.292807 17431 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.305038 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.305828 17310 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:52.280272 18072 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:52.312955 18072 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.204653 18005 consensus_queue.cc:260] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:52.279417 18010 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:52.323603 17511 tablet_bootstrap.cc:654] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:52.291846 17990 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.215247 17979 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.292505 18080 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.299809 17994 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.300065 18016 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:52.301203 18050 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:52.308139 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:52.247989 18064 consensus_queue.cc:260] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.327483 18001 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.348363 18064 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:52.352819 18091 log.cc:924] Time spent T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.141s user 0.001s sys 0.000s
W20260929 11:36:52.353785 18087 log.cc:924] Time spent T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.148s user 0.001s sys 0.000s
I20260929 11:36:52.327198 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.365736 17515 tablet_bootstrap.cc:654] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:52.360338 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.365008 18005 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.327792 18010 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.366734 17429 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.374799 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:52.361020 18050 consensus_queue.cc:1035] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260929 11:36:52.375523 17391 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:52.369777 17384 raft_consensus.cc:2379] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:52.359097 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.359186 18066 consensus_queue.cc:1046] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260929 11:36:52.406706 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.383104 18002 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:52.388439 18058 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.365211 17206 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.408540 17242 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:52.390864 17236 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:52.421247 17283 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:52.415959 18002 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:52.424435 18002 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.427582 18044 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:52.428045 18044 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:52.415074 17988 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:52.428584 18044 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.430576 18078 raft_consensus.cc:2726] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.432704 17315 raft_consensus.cc:2396] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260929 11:36:52.435388 18044 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.436596 17391 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:52.405143 18066 raft_consensus.cc:3032] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:52.466445 17511 tablet_bootstrap.cc:492] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af: No bootstrap required, opened a new log
I20260929 11:36:52.467036 17511 ts_tablet_manager.cc:1397] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af: Time spent bootstrapping tablet: real 0.303s user 0.017s sys 0.012s
I20260929 11:36:52.467840 17990 raft_consensus.cc:2726] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.468389 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:52.468545 18010 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:52.469240 17392 raft_consensus.cc:2379] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:52.471602 17994 raft_consensus.cc:2726] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.471266 18002 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:52.448629 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.472791 17384 raft_consensus.cc:2379] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:52.474262 18044 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:52.474190 17511 raft_consensus.cc:348] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.478499 17511 raft_consensus.cc:374] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:52.478854 17511 raft_consensus.cc:729] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Initialized, Role: FOLLOWER
I20260929 11:36:52.445894 18066 raft_consensus.cc:729] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:52.456255 17979 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:52.454524 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 96836us
I20260929 11:36:52.479795 17511 consensus_queue.cc:260] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.459200 17309 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:52.455037 18017 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.505729 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:52.499936 17942 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.521171 17283 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.531749 17511 ts_tablet_manager.cc:1428] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af: Time spent starting tablet: real 0.064s user 0.007s sys 0.002s
I20260929 11:36:52.501991 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.514192 17235 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:52.530299 18013 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:52.530645 18078 raft_consensus.cc:2726] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260929 11:36:52.545317 18038 log.cc:924] Time spent T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
I20260929 11:36:52.534811 17979 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:52.534464 18044 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:52.594811 18090 log.cc:924] Time spent T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260929 11:36:52.585726 17383 raft_consensus.cc:1226] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:36:52.586452 18010 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.516040 18072 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.520686 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.586094 18006 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.546015 18104 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.614101 18080 raft_consensus.cc:2726] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:52.668542 18044 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:52.668845 17386 raft_consensus.cc:2379] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:52.668974 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:52.535141 17942 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.519383 17206 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:52.625420 17236 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.597082 18027 consensus_queue.cc:1035] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.088s
I20260929 11:36:52.626190 17979 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:52.706216 17515 tablet_bootstrap.cc:492] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:52.714388 17515 ts_tablet_manager.cc:1397] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.477s user 0.013s sys 0.010s
I20260929 11:36:52.532272 18066 consensus_queue.cc:260] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:52.689847 18107 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.618495 18013 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.692843 18002 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:52.723235 17392 raft_consensus.cc:2379] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:52.719067 17979 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.677812 18010 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.722258 17971 raft_consensus.cc:2781] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:52.684290 18006 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:52.721915 18058 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:52.690591 18104 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:52.770524 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 88116.3us
I20260929 11:36:52.754781 18066 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:36:52.746500 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 236855us
I20260929 11:36:52.752296 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.760524 17971 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:52.763614 18017 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:52.785423 17357 leader_election.cc:341] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Illegal state: must be running to vote when last-logged opid is not known
I20260929 11:36:52.742084 18107 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:52.788811 18088 log.cc:924] Time spent T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.572s user 0.006s sys 0.000s
I20260929 11:36:52.793195 18013 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:52.794584 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.805837 17311 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:52.783160 17971 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:52.797435 18103 log.cc:924] Time spent T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.117s user 0.000s sys 0.000s
I20260929 11:36:52.798003 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.800792 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:52.813438 17383 raft_consensus.cc:1261] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:52.817215 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.817991 17240 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:52.827721 17385 raft_consensus.cc:1261] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:52.793286 18006 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:52.829160 17314 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:52.829931 17942 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:52.830780 17283 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:52.832548 18027 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:52.833021 18027 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:52.833490 18027 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.835240 17515 raft_consensus.cc:348] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:52.836254 17515 raft_consensus.cc:374] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:52.836640 17515 raft_consensus.cc:729] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:52.837278 17515 consensus_queue.cc:260] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:52.869606 17515 ts_tablet_manager.cc:1428] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.151s user 0.007s sys 0.000s
I20260929 11:36:52.873436 17208 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:52.876677 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 52145.5us
I20260929 11:36:52.887140 18072 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:52.875653 18069 consensus_queue.cc:1046] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:52.870657 17313 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:52.838261 17206 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:52.897459 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:52.898705 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:52.899195 17463 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:52.901621 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:52.902403 17466 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
W20260929 11:36:52.891294 17310 consensus_meta.cc:287] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.585s user 0.013s sys 0.000s
I20260929 11:36:52.910887 17356 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:52.888262 18064 consensus_queue.cc:1035] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260929 11:36:52.892692 18044 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:52.955561 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:52.894016 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.921543 17988 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:52.927489 17515 tablet_bootstrap.cc:492] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573: Bootstrap starting.
I20260929 11:36:52.931777 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:52.935770 17952 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:53.038703 17952 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:52.937286 17458 raft_consensus.cc:1261] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:53.033011 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:52.937875 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:53.026574 17953 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.938890 17463 raft_consensus.cc:1261] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:53.041041 17316 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:53.041257 17953 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:52.939888 17465 raft_consensus.cc:1261] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:52.940696 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:52.940976 18100 consensus_queue.cc:1035] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:52.941707 18120 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:53.043296 17953 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:53.043186 18120 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.044006 18111 consensus_queue.cc:1035] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:36:53.045274 18120 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:52.944774 18107 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:52.946038 17283 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:53.046387 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 100425us
I20260929 11:36:53.046540 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:53.047260 17313 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:52.947790 17994 consensus_queue.cc:1035] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:52.948182 17241 raft_consensus.cc:3037] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
W20260929 11:36:53.048449 18005 consensus_meta.cc:287] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.678s user 0.012s sys 0.000s
I20260929 11:36:53.051183 17311 raft_consensus.cc:2454] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
W20260929 11:36:53.052345 18001 consensus_meta.cc:287] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.694s user 0.011s sys 0.000s
I20260929 11:36:53.052676 18123 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:53.053119 18123 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:53.053455 18123 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:52.901625 17314 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:52.953119 18104 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:52.918252 17356 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:52.996439 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:53.057471 17384 raft_consensus.cc:2379] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:53.048497 18122 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:53.057646 17971 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.058245 18122 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.058897 17235 raft_consensus.cc:1226] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:53.059257 17236 raft_consensus.cc:1261] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:53.059818 18012 raft_consensus.cc:2726] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:53.057777 17515 tablet_bootstrap.cc:654] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573: Neither blocks nor log segments found. Creating new log.
I20260929 11:36:53.000622 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:52.997370 17385 raft_consensus.cc:1261] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:52.998723 18010 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:52.918069 18116 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:52.910156 18072 raft_consensus.cc:3032] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
W20260929 11:36:53.019512 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 58153.9us
I20260929 11:36:53.025063 18044 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:52.915452 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:52.914002 17310 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:53.025831 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.026559 17429 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:36:53.074445 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 47994.1us
I20260929 11:36:53.075969 17429 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:53.031616 17242 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
W20260929 11:36:52.959889 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 154519us
I20260929 11:36:52.918643 17950 consensus_queue.cc:1035] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.111s
I20260929 11:36:52.916500 18080 raft_consensus.cc:2726] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:53.069116 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.085826 17429 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:53.057260 17952 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:53.079453 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 161294us
I20260929 11:36:53.073954 17392 raft_consensus.cc:2379] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:53.068504 18072 raft_consensus.cc:729] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:53.086297 17463 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 0.
I20260929 11:36:53.060292 18122 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.092650 17355 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:53.097352 17942 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.087913 17283 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:53.073985 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.085587 18107 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:53.075605 17383 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:53.101468 17207 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:53.089032 17461 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:53.094704 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.063663 17237 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 0.
I20260929 11:36:53.091252 18110 raft_consensus.cc:2781] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.088817 17997 raft_consensus.cc:2726] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:53.088701 18016 raft_consensus.cc:2781] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:53.147053 17243 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:53.147149 17239 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:53.081526 18027 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.152912 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:53.079875 18044 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.085739 17994 consensus_queue.cc:1035] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260929 11:36:53.153391 18114 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.099908 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.124218 17206 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:53.154402 18033 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.158135 17356 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:53.100561 18116 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260929 11:36:53.233300 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 135376us
I20260929 11:36:53.085853 18005 consensus_queue.cc:1035] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260929 11:36:53.233580 18033 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.234128 18033 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.235059 18005 consensus_queue.cc:1035] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:53.093808 17971 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.236507 18012 raft_consensus.cc:2726] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:53.184479 17282 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:53.229409 18001 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.121819 17386 raft_consensus.cc:1261] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:53.094542 18078 consensus_queue.cc:1035] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260929 11:36:53.237581 18001 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.239666 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:53.125347 18122 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:53.239878 18001 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.205550 18016 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.240935 18016 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:53.068768 17988 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.228360 17283 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:53.230600 17431 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:53.232622 17459 raft_consensus.cc:2379] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
W20260929 11:36:53.232784 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 74728.3us
I20260929 11:36:53.237486 18058 raft_consensus.cc:2726] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:53.233538 18116 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.125326 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.205586 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.119853 17942 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:53.157924 18107 raft_consensus.cc:686] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:53.171938 18110 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.160203 18080 raft_consensus.cc:2781] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260929 11:36:53.240571 17310 raft_consensus.cc:2379] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:53.221185 18059 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:53.253930 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 161339us
I20260929 11:36:53.223206 17990 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:53.093065 18064 consensus_queue.cc:1035] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
I20260929 11:36:53.243058 18017 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.236019 17206 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:53.149631 18104 consensus_queue.cc:1046] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260929 11:36:53.269767 18050 raft_consensus.cc:2781] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.242704 18125 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:53.287878 17355 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:53.222273 18072 consensus_queue.cc:260] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.284462 18106 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:53.283843 18110 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.260860 17994 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:53.277673 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:53.295389 18010 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:36:53.311002 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 82768.2us
I20260929 11:36:53.241678 18114 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:53.320894 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 136517us
I20260929 11:36:53.288758 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.286406 17466 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:53.309265 18017 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:53.306989 18050 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.291328 18122 raft_consensus.cc:686] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:53.326265 18012 raft_consensus.cc:2781] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:53.298521 17990 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.335736 17390 raft_consensus.cc:2379] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:53.331805 18072 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.330741 17997 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.296949 18059 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.350979 18130 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.339020 18050 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.326268 17994 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:53.313069 18078 consensus_queue.cc:1035] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260929 11:36:53.338300 18006 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:53.351192 18118 raft_consensus.cc:2781] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:53.339269 17235 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
W20260929 11:36:53.336009 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 100061us
I20260929 11:36:53.349056 18012 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:53.366628 17431 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:53.321218 18125 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.327337 18106 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:53.362390 17994 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:53.333015 18010 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.374778 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.370357 18114 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.340281 18122 consensus_queue.cc:237] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.373503 18012 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:53.372682 18118 raft_consensus.cc:686] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:53.373343 18044 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.349107 18107 consensus_queue.cc:237] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.376748 17385 raft_consensus.cc:1226] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:36:53.370362 17942 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.371107 18027 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.403095 18106 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.361335 17997 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.381434 18104 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.384510 18135 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:53.366282 18006 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:53.410775 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 79871us
I20260929 11:36:53.433372 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.431861 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.409145 17988 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.438095 18125 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.440361 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.435523 18104 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.463438 18104 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.362969 18130 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.460686 17466 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:53.461288 18002 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.475756 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.385988 17206 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:53.458613 17979 consensus_meta.cc:287] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.692s user 0.011s sys 0.000s
I20260929 11:36:53.408519 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.481215 17997 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.462153 18118 consensus_queue.cc:237] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.482328 18116 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.483434 18033 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.509121 17979 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.484505 18133 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:53.500732 18002 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.520787 17979 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.520623 18133 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.485073 18010 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.455444 18123 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.489508 17282 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:36:53.489104 18132 log.cc:924] Time spent T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.129s user 0.001s sys 0.000s
I20260929 11:36:53.488790 18012 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.480806 18059 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:53.503531 18136 log.cc:924] Time spent T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260929 11:36:53.529312 18123 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.473979 18027 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.530273 18012 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.530556 18027 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.531311 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:53.443884 18135 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:53.513361 18130 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.543215 17465 raft_consensus.cc:2379] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:53.544809 18123 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.516043 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.525872 18002 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.526366 18133 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:53.527109 18033 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:53.526981 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.527766 18005 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.533239 18135 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:53.545367 18123 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.551647 18006 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:53.557319 18140 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.565789 18138 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:36:53.578162 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 108809us
I20260929 11:36:53.546770 17990 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.552889 18012 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:53.527806 17979 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.613709 17979 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.614112 17979 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.614576 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:53.615249 17391 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:53.585237 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.613722 18012 raft_consensus.cc:686] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:53.616709 17463 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:53.617295 18012 consensus_queue.cc:237] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.618085 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:53.587216 18050 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.527926 17235 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:53.579041 17243 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:53.628078 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.628716 17243 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:53.622109 18006 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.629372 18006 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.608510 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:53.608611 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:53.609072 18111 raft_consensus.cc:3032] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:53.610738 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:53.610441 17994 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:53.658488 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 370680us
I20260929 11:36:53.611366 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:53.612004 18123 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:53.584821 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 207794us
I20260929 11:36:53.591543 18005 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.621989 17282 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:53.623091 17515 tablet_bootstrap.cc:492] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573: No bootstrap required, opened a new log
I20260929 11:36:53.664731 17515 ts_tablet_manager.cc:1397] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573: Time spent bootstrapping tablet: real 0.737s user 0.017s sys 0.034s
I20260929 11:36:53.585979 18133 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.585199 18010 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.625367 18104 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.626665 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.592882 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.632050 17357 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:53.591243 18027 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.630793 17431 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:53.552143 18016 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:53.674679 17357 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:53.658944 18111 raft_consensus.cc:729] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:53.636685 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.608043 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.659593 17355 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:53.633517 17240 raft_consensus.cc:2379] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:53.686996 18006 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:53.667060 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 45156.2us
I20260929 11:36:53.687317 18130 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:53.687919 18130 raft_consensus.cc:686] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:53.689141 17466 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:53.688860 18130 consensus_queue.cc:237] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.665890 18133 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:53.676453 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 45758.2us
I20260929 11:36:53.605607 18140 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.681839 18050 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:53.660106 17313 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:53.611389 18138 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.683243 17206 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:53.666987 17310 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:53.687932 17388 raft_consensus.cc:2379] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:53.624624 18110 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.685145 17355 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:53.685855 17461 raft_consensus.cc:2379] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:53.686038 18059 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.713760 18059 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.714208 18059 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.714434 17979 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.686771 17994 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.696305 18104 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.670675 18123 raft_consensus.cc:2781] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.664067 17311 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:53.675414 18118 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.707923 17515 raft_consensus.cc:348] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.725975 17515 raft_consensus.cc:374] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260929 11:36:53.726492 17515 raft_consensus.cc:729] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Initialized, Role: FOLLOWER
I20260929 11:36:53.683669 18005 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.690292 18033 raft_consensus.cc:2781] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.712636 17429 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:53.675668 17235 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:53.685213 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:53.697197 18027 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
W20260929 11:36:53.722726 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 387273us
I20260929 11:36:53.717607 17942 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:53.737732 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.673684 18010 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.743611 17356 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:53.732491 18033 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.727181 18066 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.727739 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.711236 18006 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.722874 17383 raft_consensus.cc:2379] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:53.718952 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:53.712669 18125 raft_consensus.cc:2726] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:53.733839 17429 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:53.717398 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:53.702217 18016 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.732220 17315 raft_consensus.cc:2379] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:53.723188 18123 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.741763 18153 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.741859 17463 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:53.725829 18118 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.728444 17515 consensus_queue.cc:260] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.695009 18135 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:53.727331 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 44164.5us
I20260929 11:36:53.809624 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.810496 17243 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:53.802273 18118 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.738389 18104 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:53.740409 17460 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.746397 18033 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.811548 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:53.745822 17942 raft_consensus.cc:686] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:53.791168 18148 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.747370 18138 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.836565 18104 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:53.747681 18050 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.749595 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:36:53.791508 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 57669.1us
W20260929 11:36:53.800819 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 47906.6us
I20260929 11:36:53.751204 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:53.750944 17240 raft_consensus.cc:2454] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:53.838196 17515 ts_tablet_manager.cc:1428] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573: Time spent starting tablet: real 0.173s user 0.008s sys 0.000s
I20260929 11:36:53.839201 18110 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.842363 18135 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:53.710188 18111 consensus_queue.cc:260] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.747593 18066 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.792894 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:53.750735 18124 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.795034 18123 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.801086 17994 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.795280 18016 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.836481 17464 raft_consensus.cc:2379] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:53.877719 17318 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:53.852062 18104 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:53.739945 18027 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.851159 18114 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.853664 17243 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.884572 17357 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:53.884479 18128 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.882613 18122 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.857174 18058 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.859338 17458 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.883653 18133 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:53.914541 18016 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.914917 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:53.908988 17994 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:53.908849 17311 raft_consensus.cc:1226] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:53.915633 17942 consensus_queue.cc:237] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.917575 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:53.918252 18129 raft_consensus.cc:2726] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:53.852638 18148 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.856698 18050 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:53.891261 18125 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:53.891673 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:53.753816 18006 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.924182 18140 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.927397 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:36:53.940815 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 197267us
I20260929 11:36:53.936074 18010 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:53.938194 17994 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:53.845856 18153 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.925755 18114 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.031533 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:53.928834 18122 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:53.931937 18058 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:53.927490 18128 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:54.044793 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 160296us
I20260929 11:36:54.029410 17988 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:54.029458 17241 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:54.044445 18140 raft_consensus.cc:2781] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:53.908921 18124 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.049686 17312 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:36:54.065572 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:54.039912 17391 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:54.033365 18125 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.060819 18145 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:54.064659 17971 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.062208 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:54.063728 18140 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.079391 17431 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:54.082255 18139 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:54.083258 18154 log.cc:924] Time spent T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.174s user 0.000s sys 0.001s
I20260929 11:36:54.075917 17310 raft_consensus.cc:2379] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:54.058470 17988 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.092422 18027 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.092892 17990 raft_consensus.cc:2781] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:54.073313 18066 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.078307 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:54.093835 18122 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.101992 17990 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:54.090528 18140 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.084582 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.107868 18124 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.109385 17318 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:54.097910 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:54.093327 18139 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.110095 18125 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.118707 18153 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.089119 17971 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.077620 18145 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.123879 17460 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:54.124821 18058 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.125066 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 182) took 1079 ms. Trace:
I20260929 11:36:54.126294 17988 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.127274 18006 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.105475 18027 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.110623 17385 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.128674 17386 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:54.127913 17994 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.111023 17990 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:54.106972 18066 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.186601 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.198523 18128 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.201297 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:54.202164 17315 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.193243 17988 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.207140 18107 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.210649 18161 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.152045 18050 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.145174 18139 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.161105 17971 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.196100 18027 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.231668 18027 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.233987 17318 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:54.208936 18016 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.208259 18114 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.218739 17952 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.159072 18033 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.211198 18161 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.253262 18148 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.253700 17243 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:54.254391 17994 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.255684 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.259943 17952 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:54.265774 18059 consensus_meta.cc:287] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.551s user 0.012s sys 0.000s
I20260929 11:36:54.207494 17988 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.209210 18066 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:54.160844 17316 rpcz_store.cc:276] 0929 11:36:53.045450 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.064523 (+ 19073us) service_pool.cc:227] Handling call
0929 11:36:54.124259 (+1059736us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:54.124510 (+ 251us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:54.124688 (+ 178us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:54.124722 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:54.124770 (+ 48us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:54.124802 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:54.124875 (+ 73us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:54.124994 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6549376}
W20260929 11:36:54.279516 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 243239us
I20260929 11:36:54.279994 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.280869 17316 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:54.280941 17356 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.281956 18006 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:54.282482 18006 raft_consensus.cc:686] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:54.218005 18107 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.242753 18145 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.271234 18064 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.282102 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:54.319844 18145 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.312496 18179 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.313992 18180 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.293741 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:54.278885 18059 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.278566 17384 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:54.283417 18006 consensus_queue.cc:237] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.386686 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.411473 17463 raft_consensus.cc:2379] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:54.327176 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:54.369601 17994 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.377725 17458 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
W20260929 11:36:54.378945 18118 consensus_meta.cc:287] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.568s user 0.011s sys 0.000s
I20260929 11:36:54.361665 17235 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:54.419883 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 166) took 1170 ms. Trace:
I20260929 11:36:54.414830 18161 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.373477 17385 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:54.421221 17988 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.420295 17239 rpcz_store.cc:276] 0929 11:36:53.249010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.251419 (+ 2409us) service_pool.cc:227] Handling call
0929 11:36:54.145154 (+893735us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:54.145331 (+ 177us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:54.154388 (+ 9057us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:54.154444 (+ 56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:54.154943 (+ 499us) log.cc:842] Serialized 26 byte log entry
0929 11:36:54.364849 (+209906us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:54.368394 (+ 3545us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:54.373507 (+ 5113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:54.376364 (+ 2857us) raft_consensus.cc:1671] finished
0929 11:36:54.378936 (+ 2572us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:54.419819 (+ 40883us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2553,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4820,"spinlock_wait_cycles":8188160,"thread_start_us":175269,"threads_started":1,"wal-append.queue_time_us":153010}
I20260929 11:36:54.421985 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.422714 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.423271 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:54.423590 18059 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.293746 18064 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.424149 17385 raft_consensus.cc:2379] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:54.373888 18175 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.413431 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 108) took 1325 ms. Trace:
I20260929 11:36:54.431099 17384 rpcz_store.cc:276] 0929 11:36:53.085769 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.089484 (+ 3715us) service_pool.cc:227] Handling call
0929 11:36:54.255576 (+1166092us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:54.411510 (+155934us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6330752}
I20260929 11:36:54.420606 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.432509 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.326911 17971 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.425557 17431 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.371042 18033 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.387379 17243 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:54.423413 17239 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:54.443679 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:54.443887 17240 consensus_meta.cc:287] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.503s user 0.009s sys 0.000s
I20260929 11:36:54.444301 17239 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.444489 17240 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:54.445796 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.446619 17240 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:54.448685 18125 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:54.449733 18125 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.428141 17282 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.386574 18107 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.451830 18125 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.427738 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.426028 17994 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.435837 17384 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:54.361132 18145 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.441931 17431 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:54.358734 18123 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.448835 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.428382 17952 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.426003 17391 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.453056 17357 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.460731 18107 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.460834 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.464300 18107 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.461756 18066 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.460510 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47682 (request call id 181) took 1388 ms. Trace:
I20260929 11:36:54.432606 17235 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:54.447940 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.444084 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.467998 17357 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.441254 17942 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:54.452896 18161 raft_consensus.cc:2781] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:54.469280 17283 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.465765 17242 rpcz_store.cc:276] 0929 11:36:53.072390 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.078236 (+ 5846us) service_pool.cc:227] Handling call
0929 11:36:54.448649 (+1370413us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:54.460424 (+ 11775us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6880128}
I20260929 11:36:54.457803 18134 raft_consensus.cc:2781] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
W20260929 11:36:54.459713 18100 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.613s user 0.003s sys 0.007s
I20260929 11:36:54.413625 18180 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:54.475944 18171 log.cc:924] Time spent T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.086s user 0.001s sys 0.000s
I20260929 11:36:54.476395 18064 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.477115 18180 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.473196 17357 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:54.472785 17236 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:54.477941 17953 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:54.479561 17315 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:54.482857 17979 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.461925 17994 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.462846 17461 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:54.426205 18118 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:54.472389 18114 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.473799 17240 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:54.473024 17988 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.464795 18107 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.495975 17429 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.488014 17356 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.497400 17994 raft_consensus.cc:2781] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260929 11:36:54.497579 18169 log.cc:924] Time spent T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.437s user 0.003s sys 0.006s
I20260929 11:36:54.497807 17994 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.486056 18161 raft_consensus.cc:686] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:54.498219 17994 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.498924 18161 consensus_queue.cc:237] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.499716 18017 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.486868 18114 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.500738 18114 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.503543 17314 raft_consensus.cc:1226] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:54.503676 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:54.504616 17461 raft_consensus.cc:2379] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:54.504990 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.505537 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.505877 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 133) took 1428 ms. Trace:
I20260929 11:36:54.506002 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.490557 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.506731 17466 raft_consensus.cc:2454] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:54.506855 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.507089 17309 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:54.507474 17242 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:54.507660 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.508026 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.470420 18006 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.453536 17971 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:54.509783 17357 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.505824 17458 raft_consensus.cc:2379] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:54.479668 17990 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:54.516113 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.506399 17314 rpcz_store.cc:276] 0929 11:36:53.077135 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.080495 (+ 3360us) service_pool.cc:227] Handling call
0929 11:36:54.193937 (+1113442us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:54.501962 (+308025us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:54.504042 (+ 2080us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:54.505678 (+ 1636us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400042c50. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:54.505818 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":688109696}
I20260929 11:36:54.511576 17282 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.487165 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:36:54.493177 18178 log.cc:924] Time spent T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260929 11:36:54.524638 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.513243 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:54.513437 18158 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.528991 18158 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.529351 18158 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.485601 18140 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:54.475526 18100 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.638s user 0.004s sys 0.007s
I20260929 11:36:54.485314 17953 raft_consensus.cc:2726] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:54.492895 17988 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.411755 18179 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:54.472656 17942 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:54.522027 17357 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.523677 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:54.541762 17357 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.523757 18133 raft_consensus.cc:2781] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.523869 18131 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.514591 17206 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.493336 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:54.492455 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.502394 18134 raft_consensus.cc:686] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:54.484277 17316 raft_consensus.cc:2454] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:54.525939 17466 raft_consensus.cc:2379] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:54.551901 18072 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:54.516368 17312 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:54.518939 18006 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.488519 17241 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:54.529847 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 111) took 1437 ms. Trace:
I20260929 11:36:54.559914 18134 consensus_queue.cc:237] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.567052 17390 rpcz_store.cc:276] 0929 11:36:53.092100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.095053 (+ 2953us) service_pool.cc:227] Handling call
0929 11:36:54.529656 (+1434603us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b54000e6d54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:54.529790 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":180854016}
I20260929 11:36:54.568394 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:54.568985 17390 raft_consensus.cc:3037] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.549014 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.551419 17953 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.509363 17311 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:54.525377 17314 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:54.495672 18160 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.437120 18175 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.565302 18006 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.541051 17309 raft_consensus.cc:2354] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:36:54.539685 17988 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.572065 17957 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:54.584776 17238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 168) took 1259 ms. Trace:
I20260929 11:36:54.584576 17957 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.585659 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.523228 18145 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.530782 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.543956 18129 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.541302 17979 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.593264 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:54.593891 17463 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.555938 18072 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.544189 18133 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.552858 17464 raft_consensus.cc:2379] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:54.488211 18118 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.552002 18131 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.567106 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.558089 18012 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:54.558650 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.613847 17957 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.560293 18116 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.569022 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 160) took 1340 ms. Trace:
I20260929 11:36:54.531728 17239 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:54.587877 17388 raft_consensus.cc:2354] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:54.574558 17206 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:54.584021 18140 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.588235 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.585150 17238 rpcz_store.cc:276] 0929 11:36:53.325774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.327486 (+ 1712us) service_pool.cc:227] Handling call
0929 11:36:54.576274 (+1248788us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:54.580305 (+ 4031us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:54.583342 (+ 3037us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:54.584435 (+ 1093us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:54.584498 (+ 63us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:54.584538 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:54.584604 (+ 66us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:54.584723 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7217920}
I20260929 11:36:54.595270 17431 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:54.612532 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.582242 18123 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.591499 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:54.662139 17460 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:54.583992 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:54.614881 18104 consensus_meta.cc:287] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.689s user 0.011s sys 0.000s
I20260929 11:36:54.664762 18104 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.665283 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:54.666973 18104 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.668484 18174 raft_consensus.cc:2781] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:54.596866 17979 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.670221 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.670727 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48786 (request call id 136) took 1262 ms. Trace:
I20260929 11:36:54.671414 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:54.671605 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.614645 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.672261 17314 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:54.672739 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.673264 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:54.673682 17386 raft_consensus.cc:2379] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:54.673931 17314 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.674606 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.614769 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:54.674863 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.675256 17386 raft_consensus.cc:2454] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:54.613875 18012 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.597954 18133 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.676142 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.676257 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:54.676784 18156 log.cc:924] Time spent T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.733s user 0.000s sys 0.009s
I20260929 11:36:54.676313 18012 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.677583 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.677742 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.616742 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.617101 17994 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.693197 17994 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.617934 18175 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.660269 18110 raft_consensus.cc:2726] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:54.652781 18181 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:54.572280 17953 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.695554 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.599090 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.621495 17283 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.594236 18129 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.596797 17990 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:54.657619 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 62436us
I20260929 11:36:54.660398 18140 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:54.592751 18160 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:54.705533 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 84126.5us
I20260929 11:36:54.723523 17283 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.725137 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32868 (request call id 134) took 1257 ms. Trace:
I20260929 11:36:54.598742 17315 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:54.598327 17971 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.619092 18131 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.618350 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:54.675340 17458 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.742995 17283 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.673303 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.689818 17309 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:54.671146 17317 rpcz_store.cc:276] 0929 11:36:53.409910 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.410425 (+ 515us) service_pool.cc:227] Handling call
0929 11:36:54.529270 (+1118845us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:54.588156 (+ 58886us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934c6c 00007f79b6934bd6 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:54.670646 (+ 82490us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":25617408}
I20260929 11:36:54.757679 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.694917 18114 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.695856 17953 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.622845 17282 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:54.621840 17463 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
W20260929 11:36:54.760599 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 137825us
I20260929 11:36:54.760771 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.711475 18179 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.761754 17429 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:54.762274 17356 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:54.710932 17311 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
W20260929 11:36:54.661456 18183 log.cc:924] Time spent T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.135s user 0.001s sys 0.000s
I20260929 11:36:54.697052 17314 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:54.707896 18129 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.582541 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.746229 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.650507 17383 rpcz_store.cc:276] 0929 11:36:53.228581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.230385 (+ 1804us) service_pool.cc:227] Handling call
0929 11:36:54.568819 (+1338434us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400280354. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:54.568953 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":842652544}
W20260929 11:36:54.697288 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 136276us
I20260929 11:36:54.616019 18072 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.753499 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.694984 17390 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:36:54.714191 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:54.756861 17283 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:54.709414 17942 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.765067 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.810725 17463 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:54.811782 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.725723 17465 rpcz_store.cc:276] 0929 11:36:53.467825 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.474146 (+ 6321us) service_pool.cc:227] Handling call
0929 11:36:54.724792 (+1250646us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b54004402d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:54.725006 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":72468224}
I20260929 11:36:54.755411 17240 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.767884 18145 raft_consensus.cc:2726] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:54.744736 17357 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:36:54.818715 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 74084.2us
I20260929 11:36:54.695878 18181 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.755016 17236 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 0 FOLLOWER]: Advancing to term 1
I20260929 11:36:54.723531 18140 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:54.758280 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:54.758203 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:54.759912 18123 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:54.760226 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.768185 18137 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:54.768538 18002 raft_consensus.cc:2781] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:54.787341 17979 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.787958 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.824445 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:54.797180 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.800493 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.802909 17953 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.804543 17387 raft_consensus.cc:2354] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:54.771641 18027 raft_consensus.cc:2741] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260929 11:36:54.770705 18174 raft_consensus.cc:686] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:54.808624 18114 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.768565 18122 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:54.814131 17431 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:54.832156 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.829850 18159 raft_consensus.cc:2781] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:54.835419 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:54.910730 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 96695.7us
I20260929 11:36:54.843693 17318 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:54.784044 18158 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.808851 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.824126 17235 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:54.818934 17243 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:54.793061 17391 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:54.834829 18145 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:54.932619 18145 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:54.933017 18159 raft_consensus.cc:686] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:54.934643 18145 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.840556 17386 raft_consensus.cc:1226] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:54.840157 17309 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.934299 18159 consensus_queue.cc:237] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.936606 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.936987 18160 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.938032 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.939049 18181 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:54.939426 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:54.912652 18147 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:54.941282 18147 raft_consensus.cc:686] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:54.932633 17953 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:54.942338 18147 consensus_queue.cc:237] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.944693 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.945571 17464 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:54.945112 18174 consensus_queue.cc:237] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.956117 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.956903 17314 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:54.957245 18145 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.959524 17282 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.960345 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 115) took 1099 ms. Trace:
I20260929 11:36:54.961220 17429 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.830003 17206 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:54.841886 18002 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.842504 18123 raft_consensus.cc:686] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:54.903844 17389 raft_consensus.cc:1261] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:54.970755 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:54.860991 17317 raft_consensus.cc:2379] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:54.846736 18137 raft_consensus.cc:686] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:54.978612 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.979131 18137 consensus_queue.cc:237] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:54.846385 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.849112 17979 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.911659 17431 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:54.824110 17239 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.859114 17311 raft_consensus.cc:3037] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:54.910779 17242 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:54.857885 17237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 170) took 1518 ms. Trace:
I20260929 11:36:54.859730 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:54.841509 17988 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.919425 18122 raft_consensus.cc:686] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:54.919844 18134 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:54.920127 17459 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:54.925536 18140 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:54.886123 17315 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:54.946802 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.983784 18016 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:54.930037 18080 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:54.977496 18158 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:54.978093 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:54.995110 17240 raft_consensus.cc:2454] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:55.127576 17317 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.129323 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:54.997639 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48786 (request call id 146) took 1260 ms. Trace:
I20260929 11:36:55.130240 17282 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.007490 17312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48786 (request call id 145) took 1309 ms. Trace:
I20260929 11:36:55.004791 18131 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.140590 18138 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:54.953634 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47682 (request call id 191) took 1245 ms. Trace:
I20260929 11:36:55.140618 18010 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:54.902618 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 145853us
I20260929 11:36:55.142333 18138 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.143083 18010 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:54.981472 18181 consensus_queue.cc:1035] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260929 11:36:54.963047 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.146549 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.147851 17314 raft_consensus.cc:2379] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:55.148751 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.149026 18197 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:55.149271 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.142681 17243 rpcz_store.cc:276] 0929 11:36:53.701595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:54.275588 (+573993us) service_pool.cc:227] Handling call
0929 11:36:54.947203 (+671615us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:55.149561 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.150667 17236 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:55.150873 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.151043 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.151180 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.006392 17316 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:54.971735 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:54.980656 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 163814us
I20260929 11:36:55.007266 17309 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:55.130733 17310 rpcz_store.cc:276] 0929 11:36:53.734936 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.736881 (+ 1945us) service_pool.cc:227] Handling call
0929 11:36:54.982118 (+1245237us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54000fcdd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:54.995415 (+ 13297us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":453331840}
I20260929 11:36:54.980167 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:54.987929 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:55.008512 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 96913.8us
I20260929 11:36:55.166622 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.167153 17431 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:55.167865 17310 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:55.064167 17458 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:36:55.004065 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.171581 18131 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.046399 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 131) took 1786 ms. Trace:
I20260929 11:36:55.170913 17141 catalog_manager.cc:5495] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 1 to 2, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 2 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:55.172539 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:54.986634 17357 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:55.016079 17464 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:54.988444 17465 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:55.182227 18148 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:54.960896 17392 rpcz_store.cc:276] 0929 11:36:53.859218 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.860989 (+ 1771us) service_pool.cc:227] Handling call
0929 11:36:54.854920 (+993931us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:54.904548 (+ 49628us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:54.909006 (+ 4458us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:54.910374 (+ 1368us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:54.913122 (+ 2748us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:54.916019 (+ 2897us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:54.927353 (+ 11334us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:54.953570 (+ 26217us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12353408}
I20260929 11:36:55.182829 18148 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:55.183401 18148 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:54.983528 17388 raft_consensus.cc:2379] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:54.987676 17979 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.184702 17206 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.184453 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.032687 18012 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.028683 18016 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.053478 18006 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.201900 17458 raft_consensus.cc:1261] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:55.203174 18006 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.203577 17458 raft_consensus.cc:1226] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:54.970126 18059 raft_consensus.cc:2781] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:55.207021 18059 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.207649 18059 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:55.209077 18012 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.209739 18181 raft_consensus.cc:2741] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260929 11:36:55.210638 17384 raft_consensus.cc:2354] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:55.026258 18080 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:55.028507 18107 consensus_meta.cc:287] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.534s user 0.007s sys 0.004s
I20260929 11:36:55.212599 18159 raft_consensus.cc:2781] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:55.213368 18159 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:55.007365 18122 consensus_queue.cc:237] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:55.214066 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 69845.7us
I20260929 11:36:55.057189 18111 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:55.004667 18123 consensus_queue.cc:237] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:54.987869 17237 rpcz_store.cc:276] 0929 11:36:53.339658 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.346040 (+ 6382us) service_pool.cc:227] Handling call
0929 11:36:54.817874 (+1471834us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:54.824230 (+ 6356us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:54.829419 (+ 5189us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:54.829458 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:54.836098 (+ 6640us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:54.837230 (+ 1132us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:54.842532 (+ 5302us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:54.851111 (+ 8579us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8452480}
I20260929 11:36:54.965096 18145 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.221400 18138 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.218032 18159 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:55.059448 18133 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.232483 17313 raft_consensus.cc:2354] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for earlier term 2. Current term is 3.
I20260929 11:36:55.079046 18129 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.242367 17387 raft_consensus.cc:1226] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:55.140726 17312 rpcz_store.cc:276] 0929 11:36:53.697897 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.700420 (+ 2523us) service_pool.cc:227] Handling call
0929 11:36:55.007259 (+1306839us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400267854. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:55.007410 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":598013312}
I20260929 11:36:55.243479 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.009196 18182 raft_consensus.cc:2741] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260929 11:36:55.049566 18189 log.cc:924] Time spent T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.089s user 0.003s sys 0.000s
I20260929 11:36:55.244825 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.246034 17238 raft_consensus.cc:2379] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:55.247278 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:55.078137 18188 log.cc:924] Time spent T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.168s user 0.005s sys 0.001s
I20260929 11:36:54.984432 18160 raft_consensus.cc:2781] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:55.254410 18160 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:55.254730 17386 raft_consensus.cc:1261] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:55.254981 18160 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:55.258695 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.260726 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.262598 17431 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:54.958536 18194 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:55.124928 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.263463 18194 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
W20260929 11:36:55.068449 18196 log.cc:924] Time spent T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.170s user 0.003s sys 0.000s
I20260929 11:36:55.264065 18194 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:55.143126 17385 raft_consensus.cc:2379] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:55.151889 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.267370 17236 raft_consensus.cc:2379] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:55.151845 17243 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:55.268428 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.268641 18016 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.269286 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.270036 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.270323 17243 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:55.149609 18197 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.155195 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.271840 18197 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.155012 18184 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:55.155102 17429 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.163594 17318 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.272668 18184 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.130337 17240 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.172648 17462 rpcz_store.cc:276] 0929 11:36:53.260164 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.269379 (+ 9215us) service_pool.cc:227] Handling call
0929 11:36:53.610062 (+340683us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b580004c898. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:53.610237 (+ 175us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:53.626094 (+ 15857us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:53.626135 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:53.626598 (+ 463us) log.cc:842] Serialized 26 byte log entry
0929 11:36:54.665839 (+1039241us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b180037b820. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b694e345 00007f79bf785a39 00007f79b696b8bb 00007f79b6969cbf 00007f79b696be22 00007f79b95155bb 00007f79b951b063 00007f79b951b411 00007f79b98685cf
0929 11:36:54.839834 (+173995us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:54.843948 (+ 4114us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:54.849110 (+ 5162us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:55.039172 (+190062us) raft_consensus.cc:1671] finished
0929 11:36:55.040530 (+ 1358us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:55.046316 (+ 5786us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11000,"raft.queue_time_us":13430,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":28222208,"thread_start_us":167242,"threads_started":1,"wal-append.queue_time_us":1280389}
I20260929 11:36:55.276530 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.238098 17141 catalog_manager.cc:5495] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 reported cstate change: term changed from 0 to 1, leader changed from <none> to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 1 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:55.277314 17243 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:55.278424 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.279229 17243 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:55.279305 17462 raft_consensus.cc:1261] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260929 11:36:55.186252 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 199559us
I20260929 11:36:55.187023 17979 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:55.284691 17979 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:55.285251 17979 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.287299 17979 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.287060 18148 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.048412 17988 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.170189 18174 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:55.200426 18147 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:54.970314 18002 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:36:55.288995 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 104836us
I20260929 11:36:55.210515 18010 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.053404 17460 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:55.212971 18107 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.290674 17206 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.291527 18010 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:55.291875 18107 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.292040 18010 raft_consensus.cc:686] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:55.194303 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.293047 17466 raft_consensus.cc:2379] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:55.292961 17314 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:55.293495 18010 consensus_queue.cc:237] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.294099 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.224027 18145 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:55.294890 17465 raft_consensus.cc:1226] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:36:55.216720 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.297760 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 150) took 1093 ms. Trace:
I20260929 11:36:55.297899 17282 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.227063 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.299002 18145 raft_consensus.cc:2781] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:55.227895 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.299690 18145 raft_consensus.cc:686] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:55.301384 18145 consensus_queue.cc:237] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.230335 18191 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:55.242080 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:55.304575 18191 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.013082 18192 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:55.251995 17234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 163) took 2182 ms. Trace:
I20260929 11:36:55.262318 18138 consensus_queue.cc:1046] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:55.263616 17242 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.144680 18027 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:55.279486 17137 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41956 (request call id 66) took 4266 ms. Trace:
I20260929 11:36:55.283984 18184 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.288651 18174 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.191938 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.288761 18147 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.191718 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:55.004989 18134 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.365921 18134 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:55.346131 17240 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:55.366815 18059 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.296042 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 148) took 1350 ms. Trace:
I20260929 11:36:55.298200 17309 rpcz_store.cc:276] 0929 11:36:54.204576 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.296430 (+1091854us) service_pool.cc:227] Handling call
0929 11:36:55.296917 (+ 487us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.297315 (+ 398us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:55.297356 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:55.297432 (+ 76us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:36:55.297495 (+ 63us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.297568 (+ 73us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:55.297694 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:55.309865 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:55.325287 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 63047us
I20260929 11:36:55.328425 18107 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:55.336021 17357 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:36:55.344101 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 127778us
W20260929 11:36:55.347077 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 56602.3us
I20260929 11:36:55.355346 17239 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:36:55.347783 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:55.356022 18027 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.357894 17317 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:55.358177 17311 raft_consensus.cc:2454] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
W20260929 11:36:55.358989 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 204360us
I20260929 11:36:55.359978 18182 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:55.369204 17461 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:55.372828 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:55.398897 17313 rpcz_store.cc:276] 0929 11:36:53.946026 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.294849 (+1348823us) service_pool.cc:227] Handling call
0929 11:36:55.295343 (+ 494us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.295640 (+ 297us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:55.295677 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:55.295741 (+ 64us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:55.295781 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.295839 (+ 58us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:55.295942 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:55.375885 18133 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:55.376293 18129 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.415150 18002 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.417014 17386 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.417574 18002 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:55.418497 17457 raft_consensus.cc:1226] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:55.410883 18182 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.420934 18182 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.421561 18107 raft_consensus.cc:686] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:55.422832 18107 consensus_queue.cc:237] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.425132 17355 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:55.427219 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 151) took 1207 ms. Trace:
I20260929 11:36:55.427867 17309 rpcz_store.cc:276] 0929 11:36:54.219327 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.399427 (+1180100us) service_pool.cc:227] Handling call
0929 11:36:55.410045 (+ 10618us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.426787 (+ 16742us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:55.426829 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:55.426866 (+ 37us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:55.426912 (+ 46us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.426971 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:55.427131 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:55.429525 18129 raft_consensus.cc:2726] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:55.420956 18027 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:55.376483 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.377857 18147 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.326857 17234 rpcz_store.cc:276] 0929 11:36:53.069858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:53.070603 (+ 745us) service_pool.cc:227] Handling call
0929 11:36:54.278469 (+1207866us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:54.667849 (+389380us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:54.668018 (+ 169us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:54.668414 (+ 396us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:54.668445 (+ 31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:54.669005 (+ 560us) log.cc:842] Serialized 26 byte log entry
0929 11:36:54.784508 (+115503us) raft_consensus.cc:1631] Marking committed up to 0
0929 11:36:54.786644 (+ 2136us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:54.786742 (+ 98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:55.077673 (+290931us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b9516bee 00007f79b9515f36 00007f79b9515b58 00007f79b951f551 00007f79b951f509 00007f79b951f499
0929 11:36:55.251416 (+173743us) raft_consensus.cc:1671] finished
0929 11:36:55.251479 (+ 63us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:55.251756 (+ 277us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1220,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":21739392,"thread_start_us":104476,"threads_started":1,"wal-append.queue_time_us":176684}
I20260929 11:36:55.433624 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.435312 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.381882 17235 raft_consensus.cc:1261] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:36:55.421259 17206 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.382799 18080 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.383818 18134 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:55.384615 17238 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:55.385928 18174 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:55.386291 17459 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.397142 18194 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.387629 18191 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:55.366639 17315 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.389209 18148 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:55.390853 17237 raft_consensus.cc:1261] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:36:55.391799 18179 raft_consensus.cc:3032] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:55.331682 17312 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.392891 17236 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:55.392091 17283 leader_election.cc:398] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Vote denied by peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835) with higher term. Message: Invalid argument: T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:55.394804 17318 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:55.395444 18160 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.397399 18197 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:55.305621 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 52197.9us
I20260929 11:36:55.374984 17241 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:55.413422 18161 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:55.413525 17243 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.414136 17463 raft_consensus.cc:1226] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:55.436290 17317 raft_consensus.cc:1261] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:55.484469 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.436343 17235 pending_rounds.cc:76] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573: Aborting all ops after (but not including) 1
I20260929 11:36:55.485256 17235 pending_rounds.cc:97] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:36:55.485684 17235 raft_consensus.cc:2866] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:36:55.485926 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.486874 17235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 202) took 1125 ms. Trace:
W20260929 11:36:55.436549 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 130657us
I20260929 11:36:55.489974 18137 consensus_queue.cc:1035] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:55.414431 17311 raft_consensus.cc:1226] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:55.330971 17137 rpcz_store.cc:276] 0929 11:36:51.021037 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:51.030903 (+ 9866us) service_pool.cc:227] Handling call
0929 11:36:55.279264 (+4248361us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0929 11:36:52.433330 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0929 11:36:52.434031 (+ 701us) write_op.cc:432] Acquiring schema lock in shared mode
0929 11:36:52.434076 (+ 45us) write_op.cc:435] Acquired schema lock
0929 11:36:52.434095 (+ 19us) tablet.cc:660] Decoding operations
0929 11:36:52.434801 (+ 706us) write_op.cc:620] Acquiring the partition lock for write op
0929 11:36:52.434871 (+ 70us) write_op.cc:641] Partition lock acquired for write op
0929 11:36:52.434913 (+ 42us) tablet.cc:683] Acquiring locks for 3 operations
0929 11:36:52.435302 (+ 389us) tablet.cc:699] Row locks acquired
0929 11:36:52.435323 (+ 21us) write_op.cc:260] PREPARE: finished
0929 11:36:52.435520 (+ 197us) write_op.cc:270] Start()
0929 11:36:52.435656 (+ 136us) write_op.cc:276] Timestamp: P: 1790681812435453 usec, L: 0
0929 11:36:52.435681 (+ 25us) op_driver.cc:331] REPLICATION: starting
0929 11:36:52.450677 (+ 14996us) log.cc:842] Serialized 1325 byte log entry
0929 11:36:52.920203 (+469526us) op_driver.cc:444] REPLICATION: finished
0929 11:36:53.326499 (+406296us) write_op.cc:301] APPLY: starting
0929 11:36:53.333445 (+ 6946us) tablet.cc:1365] starting BulkCheckPresence
0929 11:36:53.348782 (+ 15337us) tablet.cc:1368] finished BulkCheckPresence
0929 11:36:53.358121 (+ 9339us) tablet.cc:1370] starting ApplyRowOperation cycle
0929 11:36:54.433072 (+1074951us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5400234090. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9529f11 00007f79b9540027 00007f79bd31ce5f 00007f79bd1bc08a 00007f79bd1be9db 00007f79bd1be5e3 00007f79bd2b8b14 00007f79bd2a4dfa 00007f79bd2a8dd1 00007f79bd2a8d89 00007f79bd2a8d19
0929 11:36:54.433354 (+ 282us) tablet.cc:1381] finished ApplyRowOperation cycle
0929 11:36:54.433602 (+ 248us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0929 11:36:54.433674 (+ 72us) write_op.cc:312] APPLY: finished
0929 11:36:54.435674 (+ 2000us) log.cc:842] Serialized 34 byte log entry
0929 11:36:54.464030 (+ 28356us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:36:54.464132 (+ 102us) write_op.cc:454] Released schema lock
0929 11:36:54.464177 (+ 45us) write_op.cc:341] FINISH: Updating metrics
0929 11:36:54.467639 (+ 3462us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:36:54.469568 (+ 1929us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1698,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":390775,"apply.run_cpu_time_us":39640,"apply.run_wall_time_us":1152520,"num_ops":3,"prepare.queue_time_us":232531,"prepare.run_cpu_time_us":3629,"prepare.run_wall_time_us":37832,"replication_time_us":484392,"spinlock_wait_cycles":2550144,"thread_start_us":499019,"threads_started":3,"wal-append.queue_time_us":28369}]]}
I20260929 11:36:55.459970 17355 leader_election.cc:398] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Vote denied by peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795) with higher term. Message: Invalid argument: T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for earlier term 2. Current term is 3.
I20260929 11:36:55.494107 17355 leader_election.cc:401] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260929 11:36:55.440536 17206 leader_election.cc:398] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795) with higher term. Message: Invalid argument: T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:36:55.495215 17206 leader_election.cc:401] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260929 11:36:55.462692 17242 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:36:55.460712 18059 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:55.467320 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.461455 17312 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:55.498744 17238 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.499747 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.469106 18197 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.478324 17465 raft_consensus.cc:1261] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:55.482839 17356 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:36:55.462332 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 70820.4us
I20260929 11:36:55.440719 18181 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:55.438753 18129 raft_consensus.cc:2781] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:55.453796 18194 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:55.487493 17235 rpcz_store.cc:276] 0929 11:36:54.361777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.301142 (+939365us) service_pool.cc:227] Handling call
0929 11:36:55.380920 (+ 79778us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:55.381247 (+ 327us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.486465 (+105218us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.486774 (+ 309us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11446144}
I20260929 11:36:55.479414 17316 raft_consensus.cc:2379] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:55.564123 17282 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.501480 17314 raft_consensus.cc:1226] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:55.437393 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.478889 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.473462 17241 raft_consensus.cc:1226] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:55.558614 18181 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.452942 17237 pending_rounds.cc:76] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Aborting all ops after (but not including) 1
I20260929 11:36:55.473870 18174 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:55.453097 18179 raft_consensus.cc:729] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:55.471048 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.478677 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.464835 17318 raft_consensus.cc:1261] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:55.476948 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.469496 17234 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.448747 17310 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:55.575083 17237 pending_rounds.cc:97] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:36:55.443979 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:55.554540 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 151) took 1192 ms. Trace:
I20260929 11:36:55.466230 17457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 232) took 1080 ms. Trace:
I20260929 11:36:55.467285 18160 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.557144 18012 raft_consensus.cc:2726] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795) with higher term. Message: Invalid argument: T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:36:55.475180 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.471647 18080 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:55.474383 17459 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:55.446049 18134 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.495010 18159 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.463107 17315 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:55.580421 17240 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.588829 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:55.589306 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:55.592555 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 152233us
I20260929 11:36:55.593544 18179 consensus_queue.cc:260] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.577023 18181 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:36:55.600965 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 45138.1us
I20260929 11:36:55.592025 17310 raft_consensus.cc:1261] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:55.473758 18161 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.605197 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:55.609647 18137 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.585239 18194 raft_consensus.cc:2741] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260929 11:36:55.619418 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 136818us
I20260929 11:36:55.584825 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 190) took 1065 ms. Trace:
I20260929 11:36:55.587579 17237 raft_consensus.cc:2866] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:36:55.621345 17283 leader_election.cc:398] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Vote denied by peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835) with higher term. Message: Invalid argument: T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:55.605774 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 194) took 1008 ms. Trace:
I20260929 11:36:55.629316 17206 leader_election.cc:302] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.629910 17429 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.630396 18179 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.630771 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.627200 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.646694 17206 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.647521 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:55.632355 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:55.648525 17459 raft_consensus.cc:2354] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:36:55.649224 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.620651 18129 raft_consensus.cc:686] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:55.635689 18159 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.610409 18174 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.637377 17431 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:55.637683 17243 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
W20260929 11:36:55.638067 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 178245us
I20260929 11:36:55.612102 18197 consensus_queue.cc:1035] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260929 11:36:55.645984 17962 raft_consensus.cc:2781] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader election won for term 1
I20260929 11:36:55.621374 17458 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:55.653980 17207 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:55.648056 17317 raft_consensus.cc:1261] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:55.644397 17236 raft_consensus.cc:2379] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:55.637733 18192 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.659042 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:55.605607 17311 rpcz_store.cc:276] 0929 11:36:54.311205 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.413628 (+1102423us) service_pool.cc:227] Handling call
0929 11:36:55.414081 (+ 453us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.492930 (+ 78849us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.504021 (+ 11091us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:55.666225 17206 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.652487 18160 raft_consensus.cc:2726] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:55.658520 18059 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:55.674885 17466 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.660683 18012 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:55.606333 17457 rpcz_store.cc:276] 0929 11:36:54.385575 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:54.386237 (+ 662us) service_pool.cc:227] Handling call
0929 11:36:55.006444 (+620207us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b580004c898. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:55.006660 (+ 216us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.418949 (+412289us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.465873 (+ 46924us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b540034dd54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:55.466137 (+ 264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":949415424}
I20260929 11:36:55.662513 17962 raft_consensus.cc:686] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:55.667930 17464 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.662297 18192 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:55.677139 17465 raft_consensus.cc:2379] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:55.663429 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.665134 18147 raft_consensus.cc:2726] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260929 11:36:55.679888 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 189952us
W20260929 11:36:55.680111 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 124347us
W20260929 11:36:55.680541 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 67270.6us
W20260929 11:36:55.688572 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 51354.4us
I20260929 11:36:55.671757 18080 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260929 11:36:55.679345 18207 log.cc:924] Time spent T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260929 11:36:55.643801 17241 rpcz_store.cc:276] 0929 11:36:54.584050 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.472810 (+888760us) service_pool.cc:227] Handling call
0929 11:36:55.473266 (+ 456us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.577335 (+104069us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.587874 (+ 10539us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:55.676131 18010 raft_consensus.cc:2726] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:55.675448 18160 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260929 11:36:55.739665 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 63768.4us
I20260929 11:36:55.676877 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:55.740836 18159 consensus_queue.cc:1035] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:55.740540 17962 consensus_queue.cc:237] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.741961 18129 consensus_queue.cc:237] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.745643 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 149) took 1676 ms. Trace:
I20260929 11:36:55.683368 18012 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:55.642925 17309 rpcz_store.cc:276] 0929 11:36:54.513355 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.431787 (+918432us) service_pool.cc:227] Handling call
0929 11:36:55.432220 (+ 433us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.560174 (+127954us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:55.561855 (+ 1681us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:55.563117 (+ 1262us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:55.570670 (+ 7553us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.573579 (+ 2909us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:55.578843 (+ 5264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:55.672930 18059 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:55.774750 18211 log.cc:924] Time spent T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.100s user 0.000s sys 0.000s
I20260929 11:36:55.752519 18174 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.753837 18122 consensus_queue.cc:1046] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:55.776540 18122 raft_consensus.cc:3032] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:55.776891 18122 raft_consensus.cc:729] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:55.777870 18012 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:55.777694 18122 consensus_queue.cc:260] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.755010 17283 leader_election.cc:398] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Vote denied by peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835) with higher term. Message: Invalid argument: T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:55.778888 17240 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:55.683524 18107 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:55.763057 17466 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
W20260929 11:36:55.783363 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 129656us
I20260929 11:36:55.762333 17357 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:55.771878 17462 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:55.766377 18160 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.687112 17237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 207) took 1101 ms. Trace:
I20260929 11:36:55.758720 17207 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.767941 17314 rpcz_store.cc:276] 0929 11:36:54.062194 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.295248 (+1233054us) service_pool.cc:227] Handling call
0929 11:36:55.501265 (+206017us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.574982 (+ 73717us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.684104 (+109122us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540002bcd0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:55.737974 (+ 53870us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":472819968}
I20260929 11:36:55.782052 17283 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.782371 17238 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:36:55.778921 18122 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:36:55.772694 18209 log.cc:924] Time spent T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.112s user 0.001s sys 0.000s
I20260929 11:36:55.786319 17431 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:55.790489 17282 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.790966 17207 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.791170 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:55.792711 18161 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:55.787101 18107 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.795815 18137 raft_consensus.cc:2726] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795) with higher term. Message: Invalid argument: T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for earlier term 2. Current term is 3.
I20260929 11:36:55.796561 18197 raft_consensus.cc:2726] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:55.797145 18080 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.797429 18012 raft_consensus.cc:2726] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:55.797636 17357 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:55.798908 18016 raft_consensus.cc:2726] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:55.799438 18059 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:55.798497 17237 rpcz_store.cc:276] 0929 11:36:54.576788 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.303225 (+726437us) service_pool.cc:227] Handling call
0929 11:36:55.387951 (+ 84726us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:55.388267 (+ 316us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.668381 (+280114us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.677860 (+ 9479us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9625472}
I20260929 11:36:55.800083 18159 consensus_queue.cc:1046] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:36:55.800084 17356 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:55.802223 17283 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.802599 17386 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:36:55.819762 18194 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:55.836774 17283 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:55.837570 18213 log.cc:924] Time spent T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260929 11:36:55.838728 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.839270 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 187) took 1351 ms. Trace:
I20260929 11:36:55.839583 17309 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
W20260929 11:36:55.839815 18214 log.cc:924] Time spent T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260929 11:36:55.803423 18160 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.839851 18027 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:55.841225 18027 raft_consensus.cc:686] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:55.842127 18027 consensus_queue.cc:237] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:55.843006 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.842928 18181 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.812503 18010 raft_consensus.cc:2726] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:55.813011 17207 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:55.824162 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48786 (request call id 153) took 1565 ms. Trace:
I20260929 11:36:55.840121 18133 raft_consensus.cc:2726] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:55.845329 17234 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:55.845726 17207 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
W20260929 11:36:55.846205 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 58135.6us
I20260929 11:36:55.846333 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.787724 17429 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:36:55.816071 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 45588.4us
I20260929 11:36:55.826552 18174 consensus_queue.cc:1046] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:55.813376 18192 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:55.820182 18002 raft_consensus.cc:2741] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260929 11:36:55.839128 17283 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.843909 17309 raft_consensus.cc:2379] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 1: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:55.828754 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.848021 18080 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:55.821005 18107 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.818115 18134 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:55.859475 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 71854.9us
I20260929 11:36:55.864485 17957 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.867363 17466 raft_consensus.cc:1261] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:55.849987 18010 raft_consensus.cc:2726] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:55.852696 18012 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:55.868070 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:55.868819 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.869768 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:55.872961 18182 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:55.864531 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 67020.6us
I20260929 11:36:55.836817 18194 raft_consensus.cc:686] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:55.877987 18216 consensus_queue.cc:1035] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:55.847790 17235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 179) took 1225 ms. Trace:
I20260929 11:36:55.878697 18129 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
W20260929 11:36:55.891160 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 91209.6us
I20260929 11:36:55.881494 18131 raft_consensus.cc:3032] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:55.884718 18012 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.885149 18059 raft_consensus.cc:2781] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:55.880679 18145 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:55.857774 18016 consensus_queue.cc:1035] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260929 11:36:55.894870 17356 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:55.845286 17316 rpcz_store.cc:276] 0929 11:36:54.259022 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.154591 (+895569us) service_pool.cc:227] Handling call
0929 11:36:55.815730 (+661139us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540050bc54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:55.824075 (+ 8345us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":476104960}
W20260929 11:36:55.893321 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 45764us
I20260929 11:36:55.894953 17460 raft_consensus.cc:2396] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:36:55.900280 17317 raft_consensus.cc:2354] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:36:55.906970 17357 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:55.897034 17431 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:55.839783 17313 rpcz_store.cc:276] 0929 11:36:54.487581 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.415402 (+927821us) service_pool.cc:227] Handling call
0929 11:36:55.415833 (+ 431us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:55.456910 (+ 41077us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:55.456947 (+ 37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:55.457584 (+ 637us) log.cc:842] Serialized 26 byte log entry
0929 11:36:55.608947 (+151363us) raft_consensus.cc:1631] Marking committed up to 0
0929 11:36:55.608997 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.609089 (+ 92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:55.838975 (+229886us) raft_consensus.cc:1671] finished
0929 11:36:55.839015 (+ 40us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:55.839189 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40474,"raft.queue_time_us":41969,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":148240,"threads_started":1,"wal-append.queue_time_us":213232}
I20260929 11:36:55.948486 17463 raft_consensus.cc:2379] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:55.898604 17283 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:55.892074 17315 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.893740 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:55.951730 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 60012.8us
I20260929 11:36:55.876267 18160 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:55.895263 18131 raft_consensus.cc:729] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:55.895208 18012 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.857062 17464 raft_consensus.cc:2454] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:36:55.901959 18181 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:55.949069 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 54292us
W20260929 11:36:55.969192 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 72230us
I20260929 11:36:55.891996 18134 consensus_queue.cc:1035] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260929 11:36:55.895959 18129 raft_consensus.cc:686] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:55.948227 18145 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:55.952790 18159 raft_consensus.cc:2781] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:55.975946 17282 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.966228 17957 raft_consensus.cc:2726] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:55.968152 18002 raft_consensus.cc:2726] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:55.969695 17962 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:55.968225 18059 raft_consensus.cc:686] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:55.895907 18010 consensus_queue.cc:1046] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
W20260929 11:36:55.982640 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 87327.7us
I20260929 11:36:55.982055 18197 raft_consensus.cc:2726] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:55.983600 18133 raft_consensus.cc:2781] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:55.980767 18159 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:55.981231 17429 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:55.980969 18145 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.989575 17355 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:55.992432 18225 consensus_queue.cc:1046] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260929 11:36:55.969909 18137 consensus_queue.cc:1035] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260929 11:36:55.985873 18181 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:56.001165 18133 raft_consensus.cc:686] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:56.001528 18181 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.002151 18133 consensus_queue.cc:237] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:56.003612 18181 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:56.001555 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:55.996434 18159 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:55.998428 17206 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:56.000459 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 113360us
I20260929 11:36:55.979216 17462 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:55.989295 17957 consensus_queue.cc:1046] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260929 11:36:55.901564 18194 consensus_queue.cc:237] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.032377 17357 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:56.030826 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 53000.3us
I20260929 11:36:55.988005 17312 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:55.894196 17235 rpcz_store.cc:276] 0929 11:36:54.622728 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:55.572196 (+949468us) service_pool.cc:227] Handling call
0929 11:36:55.589045 (+ 16849us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:55.680468 (+ 91423us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:55.683169 (+ 2701us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:55.739768 (+ 56599us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:55.761498 (+ 21730us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:55.847526 (+ 86028us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b54007026d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:55.847586 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:55.847727 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":180682496}
I20260929 11:36:56.051928 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:56.033059 18223 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
W20260929 11:36:56.054209 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 79835.9us
W20260929 11:36:56.056609 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 65172.3us
I20260929 11:36:56.044973 18006 raft_consensus.cc:3032] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:56.047637 18147 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:56.049029 17962 raft_consensus.cc:686] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:56.071722 17206 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:56.031435 18059 consensus_queue.cc:237] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.084846 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:56.088359 18228 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:56.088608 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:56.060873 18010 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:36:56.064471 18229 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:56.089613 17206 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:56.058974 18016 raft_consensus.cc:2781] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:56.091373 17283 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:56.032799 18129 consensus_queue.cc:237] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:56.068708 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:56.065873 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:56.099630 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 102336us
I20260929 11:36:56.060837 18006 raft_consensus.cc:729] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:56.048413 18131 consensus_queue.cc:260] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:56.100703 17283 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:56.101229 18027 raft_consensus.cc:2726] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:56.101907 18228 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.102888 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:56.116077 18131 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:56.116564 17283 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:56.117611 18027 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:56.117800 18192 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:56.118017 18027 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:56.118474 18027 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:56.118566 17283 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:56.120488 18206 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:56.121104 18206 raft_consensus.cc:686] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:56.121258 18006 consensus_queue.cc:260] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:56.121949 18206 consensus_queue.cc:237] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.108501 18160 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:56.123387 18160 raft_consensus.cc:2726] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:56.124644 18012 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.126464 18228 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:56.126757 18012 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:56.122848 18006 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:56.127678 18182 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:56.131429 18107 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.124091 18160 raft_consensus.cc:2726] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260929 11:36:56.132467 17962 consensus_queue.cc:237] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:56.127112 18131 consensus_queue.cc:1035] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260929 11:36:56.051748 18080 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:56.059520 18179 consensus_queue.cc:1035] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260929 11:36:56.099180 18016 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
W20260929 11:36:56.166316 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 53498.1us
I20260929 11:36:56.102023 18145 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:56.098903 18010 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:56.086958 18147 raft_consensus.cc:686] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:56.120114 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:56.104166 18229 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.191659 18229 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:56.185710 18147 consensus_queue.cc:237] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.194133 18145 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:56.114147 17317 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:36:56.176208 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:56.198733 17312 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:56.177779 17313 raft_consensus.cc:1261] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:56.179203 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:56.180804 18080 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:56.180943 18224 raft_consensus.cc:3032] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:56.181941 18027 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.168887 18016 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:56.184108 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:56.213505 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 121640us
I20260929 11:36:56.185497 18107 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:56.202838 17283 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:56.175524 18010 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:56.210994 17431 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:56.251680 17207 leader_election.cc:398] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Vote denied by peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599) with higher term. Message: Invalid argument: T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:36:56.252178 17207 leader_election.cc:401] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260929 11:36:56.210206 17316 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:56.208247 18224 raft_consensus.cc:729] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:56.217788 18216 raft_consensus.cc:3032] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:56.264369 17207 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
W20260929 11:36:56.264390 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 174856us
I20260929 11:36:56.268694 17206 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
W20260929 11:36:56.271265 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 60349.3us
W20260929 11:36:56.276988 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 107869us
I20260929 11:36:56.233124 18160 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:56.213212 18229 consensus_queue.cc:1035] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260929 11:36:56.253229 18223 raft_consensus.cc:686] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:56.262831 18012 raft_consensus.cc:2726] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599) with higher term. Message: Invalid argument: T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:36:56.263248 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:56.262976 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:56.269682 18174 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:56.267861 18216 raft_consensus.cc:729] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:56.270632 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:56.297724 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:56.305751 17206 leader_election.cc:398] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Vote denied by peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795) with higher term. Message: Invalid argument: T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:36:56.298470 17357 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:56.307322 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:56.306711 17206 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:56.308190 17466 raft_consensus.cc:2379] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:56.286427 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:56.311553 18027 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:56.315259 18231 log.cc:924] Time spent T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.216s user 0.000s sys 0.001s
I20260929 11:36:56.299136 17460 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:56.318183 18217 raft_consensus.cc:2781] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:56.319561 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:56.318794 17388 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:56.318876 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:56.319239 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:56.343950 17312 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:56.287575 18160 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.321753 18216 consensus_queue.cc:260] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.350198 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:56.312306 18228 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:56.318928 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:56.324211 17238 raft_consensus.cc:2354] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:56.311820 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:56.300433 18174 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.335206 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:56.329026 17357 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:56.299743 18225 raft_consensus.cc:2726] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:56.307390 18224 consensus_queue.cc:260] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.321005 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:56.349545 18131 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:56.349426 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:56.357921 17312 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:56.298341 18129 consensus_queue.cc:1035] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260929 11:36:56.317149 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:56.363206 17283 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:56.307638 18161 raft_consensus.cc:2726] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:56.351078 17311 raft_consensus.cc:2379] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:56.353829 18228 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:56.402729 17283 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:56.408746 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:56.409494 17318 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:56.412254 18027 raft_consensus.cc:2726] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:56.413745 18131 raft_consensus.cc:686] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:56.415729 18160 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:56.415232 18131 consensus_queue.cc:237] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:56.354637 18217 raft_consensus.cc:686] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:56.391443 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:56.395860 17206 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:56.366561 18159 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.420048 18229 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:56.384948 18223 consensus_queue.cc:237] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:56.423229 18174 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:56.481798 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:56.425794 17315 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:56.426811 18224 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:56.427340 18228 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:56.413877 17309 raft_consensus.cc:1226] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:56.483127 18027 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:56.430919 18010 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:56.438079 17318 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
W20260929 11:36:56.450251 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 54506.3us
I20260929 11:36:56.424863 18016 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.492055 17465 raft_consensus.cc:2379] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:56.494023 17429 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:56.483403 18160 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:56.389727 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:56.505527 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 143707us
I20260929 11:36:56.526257 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:56.528548 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:56.538231 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:56.502699 18229 raft_consensus.cc:686] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:56.561035 17206 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:56.567981 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 74040.8us
I20260929 11:36:56.554946 18181 raft_consensus.cc:3032] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
W20260929 11:36:56.603121 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 274164us
W20260929 11:36:56.604662 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 43718.3us
I20260929 11:36:56.557111 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:56.556262 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:56.604875 17357 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:56.586417 18179 raft_consensus.cc:2781] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:56.580999 18027 raft_consensus.cc:686] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:56.614238 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:56.615784 17206 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:36:56.613297 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 210636us
I20260929 11:36:56.618245 17283 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:56.614989 17314 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:56.598861 18160 raft_consensus.cc:686] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:56.604835 17313 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:36:56.601292 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:56.599037 18181 raft_consensus.cc:729] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:56.628984 17206 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:56.621618 17241 raft_consensus.cc:2379] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:56.602262 17316 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:56.660615 17462 raft_consensus.cc:1261] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:56.630722 18174 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:36:56.662276 17317 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:56.614311 18179 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260929 11:36:56.667018 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 43985.5us
I20260929 11:36:56.696218 17235 raft_consensus.cc:2379] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:56.705084 17314 raft_consensus.cc:1226] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:56.607064 18147 consensus_queue.cc:1035] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260929 11:36:56.659574 18206 raft_consensus.cc:2726] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:56.718726 17429 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:56.704468 18012 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:56.697022 18145 raft_consensus.cc:2741] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260929 11:36:56.699195 18129 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:56.702033 18192 raft_consensus.cc:2741] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260929 11:36:56.708643 18179 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:56.611624 18217 consensus_queue.cc:237] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.658635 18080 consensus_queue.cc:1046] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260929 11:36:56.709650 18174 raft_consensus.cc:686] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
W20260929 11:36:56.789381 18194 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s user 0.021s sys 0.026s
W20260929 11:36:56.801160 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 172265us
I20260929 11:36:56.795114 18161 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election won for term 3
W20260929 11:36:56.818080 18249 log.cc:924] Time spent T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.066s user 0.001s sys 0.000s
I20260929 11:36:56.817732 18240 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:56.818397 18235 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:56.818782 18238 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:36:56.819185 18253 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:56.817345 18237 consensus_queue.cc:1035] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260929 11:36:56.826217 18010 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:56.714227 18002 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:56.836166 17206 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:36:56.803084 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 84478.6us
I20260929 11:36:56.791501 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:56.851359 17314 raft_consensus.cc:1261] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:36:56.822173 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:56.822805 18182 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:56.824311 18159 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:56.841284 18194 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s user 0.022s sys 0.027s
I20260929 11:36:56.860646 17389 raft_consensus.cc:1226] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:56.827582 18129 raft_consensus.cc:686] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:56.853428 18080 raft_consensus.cc:3032] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:56.828821 18012 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.851934 18206 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:56.792922 18027 consensus_queue.cc:237] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.867298 18240 raft_consensus.cc:686] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:56.798780 18229 consensus_queue.cc:237] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:56.848061 18225 consensus_queue.cc:1035] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260929 11:36:56.821044 18181 consensus_queue.cc:260] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.862440 18016 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:56.905313 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:56.884627 18002 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.894739 18080 raft_consensus.cc:729] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:56.897089 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:36:56.911715 18251 log.cc:924] Time spent T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.083s user 0.000s sys 0.000s
W20260929 11:36:56.914703 18250 log.cc:924] Time spent T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.170s user 0.000s sys 0.001s
I20260929 11:36:56.915401 18224 consensus_queue.cc:1035] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:56.902662 18255 consensus_queue.cc:1046] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260929 11:36:56.867040 18161 raft_consensus.cc:686] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:56.861553 18238 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:56.893255 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:56.827292 18160 consensus_queue.cc:237] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.894220 17386 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:56.901813 18010 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:56.899940 17388 raft_consensus.cc:1261] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:56.918474 18159 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:56.958310 18159 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:56.916173 18012 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:56.964927 18255 raft_consensus.cc:3032] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:56.965431 18255 raft_consensus.cc:729] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:56.966387 18255 consensus_queue.cc:260] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.967685 18255 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:56.967319 18129 consensus_queue.cc:237] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:56.886612 18253 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.886902 18235 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:56.888058 17390 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:56.915446 18268 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:56.941547 17392 raft_consensus.cc:2379] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:56.943177 18002 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:56.933249 18238 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:56.936468 18237 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:56.945065 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:56.946131 18010 raft_consensus.cc:686] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:56.950273 17309 raft_consensus.cc:1261] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:56.951412 17384 raft_consensus.cc:2396] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:36:56.952257 18246 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:56.954306 18258 log.cc:924] Time spent T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260929 11:36:56.957170 18260 consensus_queue.cc:1035] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.035s
I20260929 11:36:56.902529 18182 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:56.935295 18181 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:56.980755 18080 consensus_queue.cc:260] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.029006 18246 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:57.037107 18080 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:57.038545 18246 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:57.040505 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:56.999096 18237 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:57.041280 17238 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:36:57.042102 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:56.984794 18159 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:56.985162 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:57.043219 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.043540 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.043885 17392 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:56.947455 18240 consensus_queue.cc:237] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:57.044824 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.046144 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:56.971374 18134 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:36:56.987775 17460 consensus_meta.cc:287] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.636s user 0.006s sys 0.004s
I20260929 11:36:57.047041 17460 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:36:57.046991 18134 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:56.978622 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.048122 17391 raft_consensus.cc:2454] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:36:57.049067 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:57.049126 18134 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:57.050235 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:56.981645 18268 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:57.051854 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:57.053170 18268 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:57.053280 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:56.988960 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:57.055130 17316 raft_consensus.cc:1261] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260929 11:36:57.055164 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 145428us
I20260929 11:36:56.908605 18206 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.042716 18237 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:56.987913 18253 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:57.051380 18182 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:57.053479 17239 raft_consensus.cc:1261] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.058868 17316 raft_consensus.cc:1261] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.059672 18269 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:57.042191 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:57.060226 18269 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:56.992712 17283 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:57.061026 17386 raft_consensus.cc:2379] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
W20260929 11:36:57.061542 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 68940.5us
I20260929 11:36:57.062356 18269 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:57.062028 18010 consensus_queue.cc:237] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:57.060724 18261 log.cc:924] Time spent T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.193s user 0.001s sys 0.000s
I20260929 11:36:57.057889 18206 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:57.063652 18270 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:57.063974 18206 raft_consensus.cc:2726] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:56.946194 18161 consensus_queue.cc:237] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:57.064215 18270 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.063946 17208 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:57.065644 18012 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:57.066303 18270 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:57.066891 18179 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:56.933228 18174 consensus_queue.cc:237] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:57.035218 17431 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 1.573s (SENT) [suppressed 21 similar messages]
I20260929 11:36:57.069633 17385 raft_consensus.cc:1261] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.091254 17208 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:57.095506 17465 raft_consensus.cc:1261] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.096740 17235 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:57.107229 17355 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
W20260929 11:36:57.108067 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 72401.1us
I20260929 11:36:57.047003 17392 raft_consensus.cc:2396] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260929 11:36:57.051394 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.126546 17207 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:57.128384 17242 raft_consensus.cc:1226] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:57.134308 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:57.096784 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:57.144253 17240 raft_consensus.cc:1226] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:36:57.075598 17282 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:57.131019 17384 raft_consensus.cc:1226] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
W20260929 11:36:57.228768 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 153243us
I20260929 11:36:57.127691 18274 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:57.133919 18181 raft_consensus.cc:2781] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:57.128770 17317 raft_consensus.cc:1226] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:57.143257 17391 raft_consensus.cc:2379] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
W20260929 11:36:57.141685 18230 log.cc:924] Time spent T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.962s user 0.000s sys 0.006s
I20260929 11:36:57.157009 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:57.064239 18134 consensus_queue.cc:1046] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
I20260929 11:36:57.134043 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:57.117413 18246 consensus_queue.cc:1035] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260929 11:36:57.228946 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 166715us
I20260929 11:36:57.142802 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:57.247575 17283 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:57.232288 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:57.149684 18228 consensus_meta.cc:287] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.591s user 0.008s sys 0.001s
W20260929 11:36:57.180431 18059 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.002s user 0.008s sys 0.018s
I20260929 11:36:57.137319 18224 raft_consensus.cc:2726] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:57.156464 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:36:57.241189 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 205983us
I20260929 11:36:57.141250 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:57.148489 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.287197 17386 raft_consensus.cc:1226] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:57.288637 18252 raft_consensus.cc:2726] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:36:57.145380 18235 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:57.289398 17391 raft_consensus.cc:1261] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.239907 18181 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:57.180512 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:57.277868 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:36:57.278846 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 131620us
W20260929 11:36:57.247910 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 110034us
I20260929 11:36:57.230490 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.239059 18145 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election won for term 4
W20260929 11:36:57.281857 18059 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s user 0.010s sys 0.018s
I20260929 11:36:57.285676 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:57.291180 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:57.245875 17389 raft_consensus.cc:1226] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:57.232115 18012 raft_consensus.cc:2726] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:57.296802 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:57.283874 18027 raft_consensus.cc:2726] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:57.282158 17388 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:36:57.297423 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 180) took 1081 ms. Trace:
I20260929 11:36:57.297782 17208 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:57.297926 17239 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:36:57.288669 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 200) took 1086 ms. Trace:
W20260929 11:36:57.298542 18276 log.cc:924] Time spent T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260929 11:36:57.281980 17392 raft_consensus.cc:1261] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.300587 17459 raft_consensus.cc:2379] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:57.230949 18179 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:57.373261 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 67445.5us
W20260929 11:36:57.372509 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 76373.6us
I20260929 11:36:57.390278 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:57.391201 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:57.451850 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 154947us
I20260929 11:36:57.307610 18181 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:57.289448 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:57.468811 17463 raft_consensus.cc:1226] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:57.282802 18228 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:57.390517 18245 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.388594 18247 consensus_queue.cc:1046] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:57.282099 18192 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.467720 17241 raft_consensus.cc:2396] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:36:57.486089 17312 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:57.456552 18107 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.446987 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 257) took 1445 ms. Trace:
I20260929 11:36:57.499022 17383 rpcz_store.cc:276] 0929 11:36:56.215767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.218036 (+ 2269us) service_pool.cc:227] Handling call
0929 11:36:57.156205 (+938169us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:57.297332 (+141127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5684992}
W20260929 11:36:57.516503 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 218770us
I20260929 11:36:57.244908 18274 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:57.557015 17242 raft_consensus.cc:2454] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:57.558369 18274 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:36:57.527740 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 392001us
I20260929 11:36:57.560312 18269 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:57.560992 18269 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.498538 18145 raft_consensus.cc:686] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 4 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:57.536998 17283 leader_election.cc:398] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Vote denied by peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361) with higher term. Message: Invalid argument: T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:57.566519 17283 leader_election.cc:401] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260929 11:36:57.534247 18059 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.542768 18027 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.526340 18012 raft_consensus.cc:2726] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:36:57.548914 17206 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:57.364113 18134 consensus_queue.cc:1035] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260929 11:36:57.543774 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:57.580575 17316 raft_consensus.cc:1261] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260929 11:36:57.580888 18282 log.cc:924] Time spent T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.141s user 0.000s sys 0.001s
I20260929 11:36:57.581073 17242 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:57.575824 17243 raft_consensus.cc:2379] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:57.582052 17316 raft_consensus.cc:3032] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:57.561321 17207 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
W20260929 11:36:57.513976 18238 consensus_meta.cc:287] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.515s user 0.009s sys 0.000s
I20260929 11:36:57.554601 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:57.534274 17234 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:36:57.545289 18174 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.572685 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:57.574479 17283 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:57.564831 18107 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:57.563517 18192 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:57.548678 17235 raft_consensus.cc:1261] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.553269 18179 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:57.553668 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 80619.5us
I20260929 11:36:57.582324 17242 raft_consensus.cc:1226] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:57.629868 18012 raft_consensus.cc:2781] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260929 11:36:57.582396 18287 log.cc:924] Time spent T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260929 11:36:57.570554 18059 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:57.575976 18027 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.578619 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:57.582340 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 200) took 1298 ms. Trace:
I20260929 11:36:57.512420 17236 rpcz_store.cc:276] 0929 11:36:56.201893 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.212786 (+ 10893us) service_pool.cc:227] Handling call
0929 11:36:57.156820 (+944034us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:57.288585 (+131765us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":18133760}
I20260929 11:36:57.573235 18224 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.657768 18145 consensus_queue.cc:237] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:57.544714 18194 consensus_queue.cc:1046] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260929 11:36:57.573057 18240 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.577976 18191 raft_consensus.cc:2726] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361) with higher term. Message: Invalid argument: T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3.
I20260929 11:36:57.768783 18255 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:57.782994 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 208574us
I20260929 11:36:57.548271 18010 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:57.783830 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 220639us
I20260929 11:36:57.769780 17316 raft_consensus.cc:729] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:57.770754 17241 raft_consensus.cc:2454] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:57.785708 18133 raft_consensus.cc:2726] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:57.578338 18245 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:57.806108 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 244868us
I20260929 11:36:57.791177 18012 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:57.793603 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 224) took 1429 ms. Trace:
I20260929 11:36:57.782528 18238 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:57.801497 17239 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:57.800387 18269 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:57.839016 18291 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.797791 17243 rpcz_store.cc:276] 0929 11:36:56.283649 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.120883 (+837234us) service_pool.cc:227] Handling call
0929 11:36:57.582145 (+461262us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400395154. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:57.582286 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":584387840}
I20260929 11:36:57.839870 18306 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:57.840410 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:57.840703 18192 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:57.840346 18299 consensus_queue.cc:1035] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260929 11:36:57.841189 18277 log.cc:924] Time spent T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.339s user 0.000s sys 0.001s
I20260929 11:36:57.553689 17464 rpcz_store.cc:276] 0929 11:36:56.001810 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.002710 (+ 900us) service_pool.cc:227] Handling call
0929 11:36:56.003049 (+ 339us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:56.003467 (+ 418us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:56.003501 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:56.003979 (+ 478us) log.cc:842] Serialized 26 byte log entry
0929 11:36:56.053298 (+ 49319us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:56.056173 (+ 2875us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:56.063758 (+ 7585us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:56.185106 (+121348us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18000ab460. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b696c799 00007f79b696fb11 00007f79b696fac9 00007f79b696fa59 00007f79b696fa21 00007f79b696ed1d 00007f79bfbd0204 00007f79bfbd0039 00007f79b694edc6
0929 11:36:57.141035 (+955929us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b9516bee 00007f79b9515f36 00007f79b9515b58 00007f79b951f551 00007f79b951f509 00007f79b951f499
0929 11:36:57.304971 (+163936us) raft_consensus.cc:1671] finished
0929 11:36:57.362871 (+ 57900us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:57.440133 (+ 77262us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18521,"raft.queue_time_us":2588,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":10804,"spinlock_wait_cycles":81176576,"thread_start_us":28859,"threads_started":1,"wal-append.queue_time_us":170851}
I20260929 11:36:57.787251 18174 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.844762 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:57.849279 17311 rpcz_store.cc:276] 0929 11:36:56.356284 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.419554 (+ 63270us) service_pool.cc:227] Handling call
0929 11:36:56.420009 (+ 455us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:56.720229 (+300220us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:56.787922 (+ 67693us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:56.826577 (+ 38655us) log.cc:842] Serialized 26 byte log entry
0929 11:36:57.042724 (+216147us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:57.042760 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:57.042838 (+ 78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:57.776677 (+733839us) raft_consensus.cc:1671] finished
0929 11:36:57.778377 (+ 1700us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:57.786082 (+ 7705us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26590,"raft.queue_time_us":65656,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":339406,"threads_started":2,"wal-append.queue_time_us":293670}
I20260929 11:36:57.845409 18107 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:57.832157 18010 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.846604 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:57.794306 18179 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:57.828943 17457 raft_consensus.cc:1261] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:36:57.827777 18194 consensus_queue.cc:1225] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer bb8e3505668b40219823840c0d8bc3af log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260929 11:36:57.832986 18080 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:57.887614 18080 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.806953 18224 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.836971 18228 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:57.850051 18012 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:57.844794 18307 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.845165 18059 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:57.830715 18255 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:57.824149 18240 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:57.873234 17431 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:57.865810 17310 raft_consensus.cc:1261] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260929 11:36:57.880411 18280 log.cc:924] Time spent T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.317s user 0.007s sys 0.003s
I20260929 11:36:57.864573 18269 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:57.882633 18294 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:57.882536 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:57.914706 18300 log.cc:924] Time spent T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.328s user 0.001s sys 0.000s
I20260929 11:36:57.915733 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.916173 17459 raft_consensus.cc:1226] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:36:57.892110 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:57.877342 17235 raft_consensus.cc:1261] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.901643 17243 raft_consensus.cc:1261] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.884737 17457 pending_rounds.cc:76] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: Aborting all ops after (but not including) 1
I20260929 11:36:57.888098 18238 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:57.904464 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:57.905069 17431 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:57.930500 17457 pending_rounds.cc:97] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:36:57.885129 18263 raft_consensus.cc:2726] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:57.930868 17457 raft_consensus.cc:2866] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:36:57.931514 18107 raft_consensus.cc:2781] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:57.931944 18107 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:57.932351 18107 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:57.888967 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:57.894209 18296 log.cc:924] Time spent T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.108s user 0.000s sys 0.000s
I20260929 11:36:57.914860 17464 raft_consensus.cc:1226] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
W20260929 11:36:57.876950 18295 log.cc:924] Time spent T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.331s user 0.001s sys 0.000s
W20260929 11:36:57.878871 18278 log.cc:924] Time spent T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.285s user 0.002s sys 0.008s
I20260929 11:36:57.867738 18291 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.914777 18294 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:57.922113 17238 raft_consensus.cc:1261] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:57.922575 18194 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:57.894111 17357 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:57.960935 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 66957.3us
I20260929 11:36:57.962136 18291 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:57.962241 18294 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:36:57.926568 18254 log.cc:924] Time spent T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 1.101s user 0.000s sys 0.012s
I20260929 11:36:57.910369 18182 raft_consensus.cc:2781] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:36:57.935782 17431 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:36:57.873525 17316 consensus_queue.cc:260] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.910892 18299 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:57.873274 18306 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:57.942960 17243 raft_consensus.cc:1226] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 3. Current term is 4. Ops: []
I20260929 11:36:57.943890 17141 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41934 (request call id 61) took 7224 ms. Trace:
W20260929 11:36:57.946549 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:57.946370 17138 catalog_manager.cc:5495] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 2, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 2 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } }
I20260929 11:36:57.922890 18269 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:57.928637 18027 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:57.949419 18107 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:57.993371 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:57.993893 17239 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:36:57.994215 18107 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:57.953879 17237 raft_consensus.cc:1226] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:57.994982 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:57.995536 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:57.910641 18307 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:57.995715 17138 catalog_manager.cc:5495] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260929 11:36:57.996563 17239 raft_consensus.cc:1226] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:57.996690 17316 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:57.954190 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 225) took 1589 ms. Trace:
I20260929 11:36:57.997567 17138 catalog_manager.cc:5495] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 1 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:36:58.000442 18299 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:57.912535 18059 consensus_queue.cc:1035] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260929 11:36:57.989485 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 52591.5us
I20260929 11:36:58.005540 17431 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:58.006844 17431 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:57.994113 17243 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:57.957024 18181 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:57.908648 18289 consensus_queue.cc:1035] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.163s
I20260929 11:36:58.004652 18285 raft_consensus.cc:3032] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:57.967134 17357 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:57.969861 18270 raft_consensus.cc:2781] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:57.987453 17141 rpcz_store.cc:276] 0929 11:36:50.719681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:50.719868 (+ 187us) service_pool.cc:227] Handling call
0929 11:36:57.943829 (+7223961us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0929 11:36:55.739085 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0929 11:36:55.747090 (+ 8005us) write_op.cc:432] Acquiring schema lock in shared mode
0929 11:36:55.747154 (+ 64us) write_op.cc:435] Acquired schema lock
0929 11:36:55.747174 (+ 20us) tablet.cc:660] Decoding operations
0929 11:36:55.747724 (+ 550us) write_op.cc:620] Acquiring the partition lock for write op
0929 11:36:55.747832 (+ 108us) write_op.cc:641] Partition lock acquired for write op
0929 11:36:55.747883 (+ 51us) tablet.cc:683] Acquiring locks for 2 operations
0929 11:36:55.748390 (+ 507us) tablet.cc:699] Row locks acquired
0929 11:36:55.748430 (+ 40us) write_op.cc:260] PREPARE: finished
0929 11:36:55.748618 (+ 188us) write_op.cc:270] Start()
0929 11:36:55.748785 (+ 167us) write_op.cc:276] Timestamp: P: 1790681815748556 usec, L: 0
0929 11:36:55.748823 (+ 38us) op_driver.cc:331] REPLICATION: starting
0929 11:36:55.749518 (+ 695us) log.cc:842] Serialized 930 byte log entry
0929 11:36:56.034117 (+284599us) op_driver.cc:444] REPLICATION: finished
0929 11:36:56.306962 (+272845us) write_op.cc:301] APPLY: starting
0929 11:36:56.311893 (+ 4931us) tablet.cc:1365] starting BulkCheckPresence
0929 11:36:56.316043 (+ 4150us) tablet.cc:1368] finished BulkCheckPresence
0929 11:36:56.316200 (+ 157us) tablet.cc:1370] starting ApplyRowOperation cycle
0929 11:36:56.318338 (+ 2138us) tablet.cc:1381] finished ApplyRowOperation cycle
0929 11:36:56.318593 (+ 255us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0929 11:36:56.318671 (+ 78us) write_op.cc:312] APPLY: finished
0929 11:36:56.318986 (+ 315us) log.cc:842] Serialized 28 byte log entry
0929 11:36:56.319153 (+ 167us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:36:56.319238 (+ 85us) write_op.cc:454] Released schema lock
0929 11:36:56.319302 (+ 64us) write_op.cc:341] FINISH: Updating metrics
0929 11:36:56.319645 (+ 343us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:36:56.319674 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":520998,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":263613,"apply.run_cpu_time_us":2911,"apply.run_wall_time_us":13043,"num_ops":2,"prepare.queue_time_us":292083,"prepare.run_cpu_time_us":43509,"prepare.run_wall_time_us":225185,"raft.queue_time_us":131220,"raft.run_cpu_time_us":28231,"raft.run_wall_time_us":183736,"replication_time_us":284021,"thread_start_us":542703,"threads_started":4,"wal-append.queue_time_us":149411,"wal-append.run_cpu_time_us":17557,"wal-append.run_wall_time_us":1467306}]]}
I20260929 11:36:58.014034 18307 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:57.971390 18245 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:58.018029 18174 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:58.020980 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 53955.3us
I20260929 11:36:57.971225 18182 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:58.022598 18306 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:58.023123 18294 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.024235 18181 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:58.024375 18269 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.006860 18246 raft_consensus.cc:3032] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:58.025014 18179 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:57.959622 18194 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.043768 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:58.045362 18194 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:57.987155 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:58.029724 18270 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:58.031701 18312 raft_consensus.cc:2726] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:58.008312 18147 raft_consensus.cc:2781] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:58.038643 18182 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:58.007653 18010 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.032119 18285 raft_consensus.cc:729] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:57.997201 17313 rpcz_store.cc:276] 0929 11:36:56.365173 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.421854 (+ 56681us) service_pool.cc:227] Handling call
0929 11:36:56.574772 (+152918us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:56.664363 (+ 89591us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:57.953989 (+1289626us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400648f50. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:57.954129 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":323816704}
I20260929 11:36:58.042233 18246 raft_consensus.cc:729] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:58.038059 18294 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.030933 18240 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:58.051555 18299 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:58.052673 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:58.054378 17461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 158) took 1761 ms. Trace:
I20260929 11:36:58.039565 18059 raft_consensus.cc:2726] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:58.029253 17241 raft_consensus.cc:1226] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:58.035434 17357 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:58.083724 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 48386.8us
I20260929 11:36:58.068451 18285 consensus_queue.cc:260] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.069526 18294 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:58.056684 18147 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:58.090461 18285 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:58.090641 18147 raft_consensus.cc:3037] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:58.054971 18224 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:58.079412 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 254726us
I20260929 11:36:58.056806 18270 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:58.094650 18080 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:58.102378 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 313213us
I20260929 11:36:58.106804 17283 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:58.097934 17357 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:58.090492 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 184) took 1251 ms. Trace:
I20260929 11:36:58.094205 18255 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:58.091090 18303 raft_consensus.cc:2726] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:36:58.108841 17387 rpcz_store.cc:276] 0929 11:36:56.846519 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.861476 (+ 14957us) service_pool.cc:227] Handling call
0929 11:36:58.052490 (+1191014us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:58.090419 (+ 37929us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3802880}
I20260929 11:36:58.110481 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:58.088442 18299 raft_consensus.cc:2726] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:36:58.120402 17283 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:58.108166 17356 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:58.143034 18197 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:36:58.103863 18246 consensus_queue.cc:260] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.143603 18197 raft_consensus.cc:686] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:58.112012 18252 raft_consensus.cc:2781] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:58.144930 18216 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:58.141873 17239 raft_consensus.cc:2454] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:36:58.152064 18313 raft_consensus.cc:2781] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:58.144205 18147 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:58.072207 17461 rpcz_store.cc:276] 0929 11:36:56.292594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.292793 (+ 199us) service_pool.cc:227] Handling call
0929 11:36:56.305498 (+ 12705us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:56.346438 (+ 40940us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:56.350152 (+ 3714us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:56.350719 (+ 567us) log.cc:842] Serialized 26 byte log entry
0929 11:36:56.488959 (+138240us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:36:56.507502 (+ 18543us) log.cc:842] Serialized 14 byte log entry
0929 11:36:56.511740 (+ 4238us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:56.525584 (+ 13844us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:57.922993 (+1397409us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b9516bee 00007f79b9515f36 00007f79b9515b58 00007f79b951f551 00007f79b951f509 00007f79b951f499
0929 11:36:58.054062 (+131069us) raft_consensus.cc:1671] finished
0929 11:36:58.054170 (+ 108us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:58.054316 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17683,"prepare.queue_time_us":1869,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":43982,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":12891,"spinlock_wait_cycles":15637760,"thread_start_us":137808,"threads_started":1,"wal-append.queue_time_us":307410}
I20260929 11:36:58.154345 18147 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:58.144610 18197 consensus_queue.cc:237] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.141577 18027 consensus_queue.cc:1035] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260929 11:36:58.152655 18313 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:58.144133 18246 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:58.171482 18299 raft_consensus.cc:2726] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260929 11:36:58.158670 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 51017.3us
I20260929 11:36:58.092280 18312 consensus_queue.cc:1035] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260929 11:36:58.169728 18313 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:58.160043 17283 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:58.119506 18194 consensus_queue.cc:1046] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260929 11:36:58.180289 17357 leader_election.cc:302] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:58.158213 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:58.158524 18252 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:58.177151 18134 raft_consensus.cc:2781] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:36:58.185360 18134 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.185508 18299 consensus_queue.cc:1035] T 99e908ebf22e447487392401adf8bfd8 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:58.185745 18134 raft_consensus.cc:3037] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:58.189462 17356 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:58.147140 18012 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.197227 17356 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:36:58.205382 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 334563us
I20260929 11:36:58.183007 18224 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:58.184280 18252 raft_consensus.cc:3037] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:58.184685 18312 consensus_queue.cc:1046] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260929 11:36:58.196836 17316 raft_consensus.cc:1261] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:36:58.194504 18289 raft_consensus.cc:2781] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:36:58.238555 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 231768us
I20260929 11:36:58.226472 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:58.194320 17235 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
W20260929 11:36:58.253381 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 56265.5us
I20260929 11:36:58.187379 18006 consensus_queue.cc:1035] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260929 11:36:58.197458 18240 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.199533 18299 raft_consensus.cc:2726] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:36:58.266206 18307 consensus_queue.cc:1035] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:36:58.214713 18303 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.268527 17431 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:58.269531 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:58.260831 18289 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:58.226347 18191 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:58.259713 17316 pending_rounds.cc:76] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a: Aborting all ops after (but not including) 1
I20260929 11:36:58.283890 18179 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:58.238873 18224 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:58.285977 17283 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:36:58.288385 17314 raft_consensus.cc:1226] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [term 4 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:36:58.281075 17243 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:36:58.260537 18311 raft_consensus.cc:2726] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:58.260684 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:58.283406 18289 raft_consensus.cc:3037] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:58.285615 17316 pending_rounds.cc:97] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:36:58.304032 17389 raft_consensus.cc:1226] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:58.284523 18245 consensus_queue.cc:1046] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:36:58.281175 18260 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.294287 18194 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.277350 18240 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.303663 17311 raft_consensus.cc:1261] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:36:58.308375 17316 raft_consensus.cc:2866] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:36:58.334770 17207 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:58.338797 17207 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
W20260929 11:36:58.340946 18290 log.cc:924] Time spent T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.797s user 0.005s sys 0.000s
I20260929 11:36:58.340718 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:58.288385 18191 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:58.317098 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:58.333190 17311 pending_rounds.cc:76] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a: Aborting all ops after (but not including) 1
W20260929 11:36:58.320647 17358 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.674s user 0.011s sys 0.015s
I20260929 11:36:58.295814 18306 consensus_queue.cc:1035] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260929 11:36:58.357803 17207 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:58.382606 17207 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:58.282208 18303 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.337407 18285 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.353266 18080 raft_consensus.cc:2726] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:36:58.392081 18310 raft_consensus.cc:2726] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260929 11:36:58.381083 17358 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.742s user 0.012s sys 0.016s
I20260929 11:36:58.361260 17311 pending_rounds.cc:97] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:36:58.355222 18147 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.334719 18299 consensus_queue.cc:1046] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260929 11:36:58.327780 18194 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.326653 18260 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.389343 18269 raft_consensus.cc:2726] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:36:58.449884 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 50513.9us
I20260929 11:36:58.439309 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:58.451786 18308 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.452481 18308 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:58.454900 18308 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:58.389660 18012 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.468981 18270 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:58.471189 18270 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:58.400095 17311 raft_consensus.cc:2866] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:36:58.441659 18224 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:58.484359 17431 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:58.487025 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:58.393812 18181 consensus_queue.cc:1046] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260929 11:36:58.489145 17466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 193) took 1469 ms. Trace:
I20260929 11:36:58.456281 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:58.397805 18285 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:58.459672 18147 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:58.491335 17466 rpcz_store.cc:276] 0929 11:36:57.019774 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.019965 (+ 191us) service_pool.cc:227] Handling call
0929 11:36:57.041452 (+ 21487us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:57.041647 (+ 195us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:57.041671 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:57.146851 (+105180us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b2c002850e8. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b8277e11 00007f79b8287442 00007f79b98cfc11 00007f79b989458a 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772
0929 11:36:57.147229 (+ 378us) log.cc:842] Serialized 26 byte log entry
0929 11:36:57.281601 (+134372us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:57.281642 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:57.281703 (+ 61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:58.294677 (+1012974us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b9516bee 00007f79b9515f36 00007f79b9515b58 00007f79b951f551 00007f79b951f509 00007f79b951f499
0929 11:36:58.488861 (+194184us) raft_consensus.cc:1671] finished
0929 11:36:58.488891 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:58.489072 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":77102336,"thread_start_us":134055,"threads_started":1,"wal-append.queue_time_us":368568}
I20260929 11:36:58.489859 18161 raft_consensus.cc:2726] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:36:58.522637 17431 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:58.495563 18223 raft_consensus.cc:3032] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:36:58.490087 18197 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:58.525561 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:36:58.526628 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 263792us
I20260929 11:36:58.496083 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:58.523780 18133 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:36:58.514045 18324 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:58.547763 17463 raft_consensus.cc:1226] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:36:58.502619 17383 raft_consensus.cc:2362] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2. Re-sending same reply.
I20260929 11:36:58.552521 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:58.527410 18223 raft_consensus.cc:729] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:58.531672 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:58.573369 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:58.538738 18197 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.574990 18271 consensus_queue.cc:1046] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260929 11:36:58.545838 18161 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:36:58.546828 18318 raft_consensus.cc:2726] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260929 11:36:58.593153 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 67904.5us
I20260929 11:36:58.572885 18181 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.591359 18161 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:58.596920 18148 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.597146 18260 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.597714 18259 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.598752 18331 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.610706 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:58.602134 18245 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.574548 18240 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.542254 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:58.585152 18145 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.613243 18194 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.596016 17392 raft_consensus.cc:2396] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:36:58.604698 17431 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:58.592281 18191 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:58.593945 18174 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.514819 18336 consensus_queue.cc:1046] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260929 11:36:58.613616 18147 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.626526 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:58.631795 18330 log.cc:924] Time spent T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.174s user 0.001s sys 0.000s
I20260929 11:36:58.595484 18324 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:58.632707 18223 consensus_queue.cc:260] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.634629 18197 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:58.636973 18182 consensus_meta.cc:287] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.573s user 0.011s sys 0.000s
I20260929 11:36:58.636857 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:58.638149 17431 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:58.617344 17464 raft_consensus.cc:2379] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
W20260929 11:36:58.643646 18326 log.cc:924] Time spent T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.244s user 0.001s sys 0.000s
I20260929 11:36:58.644244 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:58.609572 18303 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:58.646596 17311 raft_consensus.cc:1261] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:36:58.647802 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:58.614404 18181 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:58.618844 18148 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:36:58.649652 18320 log.cc:924] Time spent T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.273s user 0.001s sys 0.001s
I20260929 11:36:58.611227 18161 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:58.630610 18240 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:36:58.697803 18338 log.cc:924] Time spent T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.065s user 0.000s sys 0.001s
I20260929 11:36:58.621102 18245 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:58.684214 18012 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.686095 18308 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.695932 17311 pending_rounds.cc:76] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: Aborting all ops after (but not including) 1
I20260929 11:36:58.688488 18147 raft_consensus.cc:2726] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:58.591277 18298 consensus_queue.cc:1035] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.162s
I20260929 11:36:58.694744 18238 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:36:58.730631 18323 log.cc:924] Time spent T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.184s user 0.000s sys 0.001s
I20260929 11:36:58.731774 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 180) took 1731 ms. Trace:
I20260929 11:36:58.732131 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:58.630955 18145 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.734206 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:58.656983 18174 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.729091 17311 pending_rounds.cc:97] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:36:58.756016 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 265) took 1758 ms. Trace:
I20260929 11:36:58.728477 18223 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:58.690191 18182 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:36:58.744642 18313 consensus_meta.cc:287] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.568s user 0.007s sys 0.005s
I20260929 11:36:58.743703 18285 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:58.780359 17465 rpcz_store.cc:276] 0929 11:36:56.997142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.997473 (+ 331us) service_pool.cc:227] Handling call
0929 11:36:57.031591 (+ 34118us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:57.126390 (+ 94799us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:58.749322 (+1622932us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b5400531954. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:58.755934 (+ 6612us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":95677184}
I20260929 11:36:58.789467 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:58.707639 18240 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:58.781347 18246 consensus_meta.cc:287] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.605s user 0.010s sys 0.001s
I20260929 11:36:58.747901 17461 raft_consensus.cc:2454] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:58.727949 18012 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.804144 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:36:58.805006 18317 log.cc:924] Time spent T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.248s user 0.000s sys 0.001s
I20260929 11:36:58.805589 18012 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.780084 17311 raft_consensus.cc:2866] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:36:58.733220 18308 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:58.803610 17463 raft_consensus.cc:1261] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:36:58.808609 17463 pending_rounds.cc:76] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Aborting all ops after (but not including) 1
I20260929 11:36:58.808851 17463 pending_rounds.cc:97] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:36:58.809068 17463 raft_consensus.cc:2866] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260929 11:36:58.810479 18134 consensus_meta.cc:287] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.624s user 0.009s sys 0.000s
I20260929 11:36:58.810655 18308 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:58.810972 18134 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.811812 17239 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
W20260929 11:36:58.812472 18322 log.cc:924] Time spent T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.249s user 0.001s sys 0.001s
I20260929 11:36:58.799902 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:58.814275 17465 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:58.630354 18259 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:58.642750 18331 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:58.787919 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:36:58.748746 18238 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:58.822168 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:58.840777 18327 log.cc:924] Time spent T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.230s user 0.000s sys 0.001s
I20260929 11:36:58.841008 17237 raft_consensus.cc:1261] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:36:58.750412 18324 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.868271 17466 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:58.798018 18285 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:58.801038 18303 raft_consensus.cc:2726] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:58.788915 18313 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.841432 18181 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:58.870132 17237 pending_rounds.cc:76] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: Aborting all ops after (but not including) 1
I20260929 11:36:58.842535 17459 raft_consensus.cc:1226] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: []
W20260929 11:36:58.883294 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 342430us
I20260929 11:36:58.881598 18148 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.877993 18298 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.891326 17237 pending_rounds.cc:97] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:36:58.906535 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 226) took 1918 ms. Trace:
I20260929 11:36:58.894039 18335 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:58.896142 18319 consensus_queue.cc:1035] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.237s
I20260929 11:36:58.882719 18285 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:58.907107 17240 rpcz_store.cc:276] 0929 11:36:56.982552 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:56.982731 (+ 179us) service_pool.cc:227] Handling call
0929 11:36:57.143954 (+161223us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:57.183137 (+ 39183us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:58.900525 (+1717388us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540064e450. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:58.900702 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":291572096}
I20260929 11:36:58.901888 18182 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:58.906167 17237 raft_consensus.cc:2866] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:36:58.900068 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:58.899560 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:58.945884 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:58.955679 17240 raft_consensus.cc:2396] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:36:58.948066 18272 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:36:58.745769 17318 rpcz_store.cc:276] 0929 11:36:57.000241 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.933061 (+932820us) service_pool.cc:227] Handling call
0929 11:36:57.933575 (+ 514us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:57.933955 (+ 380us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:57.933985 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:57.934502 (+ 517us) log.cc:842] Serialized 26 byte log entry
0929 11:36:58.182280 (+247778us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:58.182319 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:58.183768 (+ 1449us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:58.731552 (+547784us) raft_consensus.cc:1671] finished
0929 11:36:58.731570 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:58.731722 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1231,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":3564,"thread_start_us":242980,"threads_started":1,"wal-append.queue_time_us":333728}
I20260929 11:36:58.929502 18134 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.959334 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:58.990872 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:58.992112 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:36:59.029016 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:58.942631 18191 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.943648 18197 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:58.950299 18245 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.939101 18308 consensus_queue.cc:1035] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260929 11:36:58.948711 18285 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:58.937271 18181 consensus_queue.cc:1046] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
W20260929 11:36:59.075304 18252 consensus_meta.cc:287] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.806s user 0.010s sys 0.001s
I20260929 11:36:59.097138 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:58.956295 18257 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:59.030059 18313 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:59.102782 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:59.107477 17240 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:36:58.959481 18331 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:58.989085 18182 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:59.028563 18145 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:59.156167 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:36:59.102092 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 464040us
I20260929 11:36:59.105866 17392 raft_consensus.cc:2379] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
W20260929 11:36:59.112972 18289 consensus_meta.cc:287] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.783s user 0.011s sys 0.000s
W20260929 11:36:59.108896 18179 consensus_meta.cc:287] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.825s user 0.010s sys 0.002s
I20260929 11:36:59.159667 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:58.949733 18335 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.160885 17431 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:59.153123 17309 raft_consensus.cc:2396] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:36:58.922367 18298 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.106356 18240 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:58.942596 18333 consensus_queue.cc:1035] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.220s
I20260929 11:36:59.205017 17431 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:36:59.112725 18197 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.115343 18309 raft_consensus.cc:3032] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:59.098740 18191 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.201562 18179 raft_consensus.cc:2726] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:59.183861 18182 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.221690 17465 raft_consensus.cc:1261] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:59.202209 18246 raft_consensus.cc:2726] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:36:59.192368 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:59.210028 18328 log.cc:924] Time spent T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.332s user 0.000s sys 0.001s
I20260929 11:36:59.201435 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:59.202404 18259 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:59.192004 17466 raft_consensus.cc:2379] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:59.112112 18252 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:59.160063 18233 consensus_queue.cc:1046] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260929 11:36:59.111780 18257 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:59.239238 18341 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:59.240190 18335 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:36:59.230374 18337 log.cc:924] Time spent T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.348s user 0.001s sys 0.001s
I20260929 11:36:59.223698 18309 raft_consensus.cc:729] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:59.183733 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:59.222527 18345 raft_consensus.cc:2781] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:36:59.250188 17466 raft_consensus.cc:1261] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260929 11:36:59.241686 17235 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s user 0.015s sys 0.009s
I20260929 11:36:59.188714 18289 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:36:59.269805 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:36:59.090823 18272 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.233762 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:36:59.242813 17358 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.686s user 0.005s sys 0.042s
W20260929 11:36:59.242628 18336 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.510s user 0.013s sys 0.002s
I20260929 11:36:59.238320 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:59.370149 17356 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:59.369138 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 214) took 1058 ms. Trace:
W20260929 11:36:59.370908 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 436195us
I20260929 11:36:59.244263 18259 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:36:59.410984 17431 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:59.368587 17235 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s user 0.015s sys 0.009s
W20260929 11:36:59.371022 17310 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s user 0.014s sys 0.040s
W20260929 11:36:59.413491 17310 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.599s user 0.014s sys 0.041s
W20260929 11:36:59.413414 18351 log.cc:924] Time spent T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.190s user 0.000s sys 0.000s
I20260929 11:36:59.412624 17240 rpcz_store.cc:276] 0929 11:36:58.310361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.182695 (+872334us) service_pool.cc:227] Handling call
0929 11:36:59.369052 (+186357us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:59.414776 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 247) took 1083 ms. Trace:
I20260929 11:36:59.414911 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:36:59.415148 17316 rpcz_store.cc:276] 0929 11:36:58.331472 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.443291 (+111819us) service_pool.cc:227] Handling call
0929 11:36:58.474774 (+ 31483us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:58.499984 (+ 25210us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:58.511992 (+ 12008us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:58.594766 (+ 82774us) log.cc:842] Serialized 26 byte log entry
0929 11:36:59.051312 (+456546us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:59.072533 (+ 21221us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.097278 (+ 24745us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:59.414559 (+317281us) raft_consensus.cc:1671] finished
0929 11:36:59.414586 (+ 27us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:59.414724 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1188,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":20999,"thread_start_us":359969,"threads_started":1,"wal-append.queue_time_us":556579}
I20260929 11:36:59.416388 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 221) took 1104 ms. Trace:
I20260929 11:36:59.416702 17240 rpcz_store.cc:276] 0929 11:36:58.315053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.414658 (+1099605us) service_pool.cc:227] Handling call
0929 11:36:59.416309 (+ 1651us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:59.417112 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.417696 17316 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:59.417838 17240 raft_consensus.cc:1261] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:59.418349 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 237) took 1174 ms. Trace:
I20260929 11:36:59.418566 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.418663 17240 rpcz_store.cc:276] 0929 11:36:58.244345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.417274 (+1172929us) service_pool.cc:227] Handling call
0929 11:36:59.417545 (+ 271us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:59.418151 (+ 606us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.418308 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:59.419854 17240 raft_consensus.cc:1226] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:36:59.420428 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 238) took 1175 ms. Trace:
I20260929 11:36:59.420516 17309 raft_consensus.cc:2379] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:36:59.420733 17240 rpcz_store.cc:276] 0929 11:36:58.244693 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.419399 (+1174706us) service_pool.cc:227] Handling call
0929 11:36:59.419666 (+ 267us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:59.420202 (+ 536us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.420384 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:59.421329 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.330271 18122 raft_consensus.cc:3032] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:59.421927 17240 raft_consensus.cc:1261] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:36:59.422060 18122 raft_consensus.cc:729] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:36:59.422328 18272 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:59.419745 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.422542 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 239) took 1177 ms. Trace:
I20260929 11:36:59.427697 17240 rpcz_store.cc:276] 0929 11:36:58.244973 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.421416 (+1176443us) service_pool.cc:227] Handling call
0929 11:36:59.421668 (+ 252us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:59.422332 (+ 664us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.422503 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:59.422894 18122 consensus_queue.cc:260] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:59.421936 17309 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:36:59.447384 18145 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:59.448777 17389 raft_consensus.cc:2379] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:36:59.447209 18122 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:36:59.426716 17358 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.852s user 0.008s sys 0.049s
W20260929 11:36:59.456805 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 45925.3us
I20260929 11:36:59.322978 17318 raft_consensus.cc:2379] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:36:59.324842 18240 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:36:59.427220 18336 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.738s user 0.013s sys 0.014s
I20260929 11:36:59.472285 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 214) took 2353 ms. Trace:
I20260929 11:36:59.472914 18240 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:36:59.473461 18147 raft_consensus.cc:3032] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:36:59.473869 18147 raft_consensus.cc:729] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:59.473927 18131 raft_consensus.cc:3032] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:59.474385 18131 raft_consensus.cc:729] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:59.475144 18240 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:36:59.406801 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 200) took 1164 ms. Trace:
I20260929 11:36:59.475605 17384 rpcz_store.cc:276] 0929 11:36:58.242027 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.246833 (+ 4806us) service_pool.cc:227] Handling call
0929 11:36:59.190959 (+944126us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:36:59.373332 (+182373us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12032384}
I20260929 11:36:59.477038 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:59.477646 17384 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:59.477718 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 205) took 1606 ms. Trace:
I20260929 11:36:59.478597 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:59.458455 17431 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:59.481623 17431 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:59.479900 18059 raft_consensus.cc:3032] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:36:59.479847 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:36:59.445048 18298 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:59.465022 18331 raft_consensus.cc:2726] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:36:59.430447 18259 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.474696 18147 consensus_queue.cc:260] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:59.447686 18225 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:59.469616 18224 raft_consensus.cc:3032] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:36:59.458843 18145 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:59.458309 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 240) took 1213 ms. Trace:
I20260929 11:36:59.428339 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:36:59.465385 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 297680us
I20260929 11:36:59.535725 17240 rpcz_store.cc:276] 0929 11:36:58.245254 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.455542 (+1210288us) service_pool.cc:227] Handling call
0929 11:36:59.457772 (+ 2230us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:59.457958 (+ 186us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:59.457993 (+ 35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:59.458048 (+ 55us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:59.458073 (+ 25us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.458117 (+ 44us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:59.458233 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:59.478150 17241 rpcz_store.cc:276] 0929 11:36:57.871853 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.951423 (+ 79570us) service_pool.cc:227] Handling call
0929 11:36:58.008240 (+ 56817us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:58.089899 (+ 81659us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.477519 (+1387620us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b540061a3d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:36:59.477659 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":118605568}
I20260929 11:36:59.486467 18059 raft_consensus.cc:729] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:59.475173 18131 consensus_queue.cc:260] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:59.472823 17236 rpcz_store.cc:276] 0929 11:36:57.119245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.836752 (+717507us) service_pool.cc:227] Handling call
0929 11:36:57.875057 (+ 38305us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:58.033144 (+158087us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:58.036192 (+ 3048us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:58.037722 (+ 1530us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:58.037773 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.472021 (+1434248us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002d8cd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:59.472077 (+ 56us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:59.472219 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":323184896}
I20260929 11:36:59.503769 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:36:59.469648 18344 log.cc:924] Time spent T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
W20260929 11:36:59.486756 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 116349us
I20260929 11:36:59.461199 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:36:59.519091 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:59.482700 18191 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:59.459554 18267 consensus_queue.cc:1046] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260929 11:36:59.486739 18348 raft_consensus.cc:2726] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:36:59.500586 18233 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:36:59.448833 18345 raft_consensus.cc:686] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:36:59.500988 18358 raft_consensus.cc:2726] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:36:59.526051 18240 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:59.530906 18224 raft_consensus.cc:729] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:36:59.511909 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.537977 17431 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
W20260929 11:36:59.713892 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 175981us
I20260929 11:36:59.520893 18275 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:36:59.543587 17355 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:59.500617 18285 consensus_queue.cc:1035] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260929 11:36:59.546933 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 153) took 1214 ms. Trace:
I20260929 11:36:59.370282 18341 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:59.593408 17356 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:36:59.482263 18309 consensus_queue.cc:260] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:59.542148 18217 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:59.550225 18311 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:59.698204 18257 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:59.522526 18357 consensus_queue.cc:1035] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.122s
I20260929 11:36:59.555148 18147 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:59.535179 18225 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:59.554064 18197 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:36:59.724900 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 239215us
I20260929 11:36:59.633891 17318 raft_consensus.cc:2454] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:59.630787 18350 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:59.708791 18313 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:59.703692 17466 raft_consensus.cc:1226] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:36:59.701318 18252 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:59.717085 18182 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:36:59.761538 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 168248us
I20260929 11:36:59.762620 17356 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:36:59.550117 18355 consensus_queue.cc:1046] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.160s
I20260929 11:36:59.718945 18275 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:59.719359 18179 raft_consensus.cc:2726] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:36:59.721947 18348 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:59.704808 18233 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:59.734234 17316 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:59.744777 18289 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:59.765286 17235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 221) took 1604 ms. Trace:
I20260929 11:36:59.746155 18217 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:59.763876 18309 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:36:59.720772 18240 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:36:59.775849 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 235654us
I20260929 11:36:59.762298 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:59.775091 18275 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:59.717931 18059 consensus_queue.cc:260] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:36:59.765062 18197 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:36:59.756273 18224 consensus_queue.cc:260] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:59.766607 18252 raft_consensus.cc:2726] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:36:59.749833 18311 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.782269 18343 raft_consensus.cc:2726] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260929 11:36:59.815004 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 50679.8us
I20260929 11:36:59.764865 18350 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:59.790413 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 215) took 1477 ms. Trace:
I20260929 11:36:59.788501 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 249) took 1262 ms. Trace:
I20260929 11:36:59.782985 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.779157 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:36:59.790246 18335 consensus_queue.cc:1035] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260929 11:36:59.811810 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 173) took 1181 ms. Trace:
I20260929 11:36:59.830308 17207 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:59.764493 18313 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:59.786906 18179 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:36:59.811681 18223 consensus_meta.cc:287] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 1.023s user 0.005s sys 0.005s
I20260929 11:36:59.797742 18355 consensus_queue.cc:1225] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Peer 013a37bea2eb40c0ad4ce8f296176573 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
W20260929 11:36:59.806751 18362 log.cc:924] Time spent T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.097s user 0.000s sys 0.001s
I20260929 11:36:59.923056 18375 raft_consensus.cc:2726] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260929 11:36:59.914923 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 84703.1us
I20260929 11:36:59.809324 18233 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:36:59.924381 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 89634.6us
I20260929 11:36:59.809808 18059 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:36:59.810264 18225 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:59.834728 18259 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:59.811163 18217 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:59.813432 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.812709 18289 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:59.806033 18366 raft_consensus.cc:2781] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:36:59.915803 17463 rpcz_store.cc:276] 0929 11:36:58.630601 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.630908 (+ 307us) service_pool.cc:227] Handling call
0929 11:36:58.652527 (+ 21619us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:58.809442 (+156915us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.811587 (+1002145us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400056c54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:59.811756 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":343362816}
I20260929 11:36:59.893373 18197 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:59.955617 17207 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:36:59.834563 18229 raft_consensus.cc:3032] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:36:59.787122 18253 consensus_queue.cc:1035] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260929 11:36:59.813352 17464 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:36:59.990090 17207 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:36:59.959580 17208 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:36:59.830847 18240 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:36:59.836371 18145 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:36:59.929287 17234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 230) took 2904 ms. Trace:
I20260929 11:36:59.924000 17309 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:59.930042 17392 raft_consensus.cc:2454] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:36:59.990548 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:36:59.961803 18365 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:59.972373 18357 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:36:59.929999 18179 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:36:59.977561 18366 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:36:59.962117 18375 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:00.002072 18197 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.003062 17384 raft_consensus.cc:2454] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:36:59.992774 18371 raft_consensus.cc:2726] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:36:59.915000 17310 rpcz_store.cc:276] 0929 11:36:58.524703 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.699358 (+174655us) service_pool.cc:227] Handling call
0929 11:36:58.743034 (+ 43676us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:58.773940 (+ 30906us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:36:59.454884 (+680944us) log.cc:842] Serialized 14 byte log entry
0929 11:36:59.757833 (+302949us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:59.759570 (+ 1737us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:36:59.766005 (+ 6435us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.774416 (+ 8411us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:59.787238 (+ 12822us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":675409,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":3374,"raft.queue_time_us":205903,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8239,"thread_start_us":894918,"threads_started":3,"wal-append.queue_time_us":83596}
I20260929 11:36:59.991940 18229 raft_consensus.cc:729] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:36:59.784614 17235 rpcz_store.cc:276] 0929 11:36:58.160534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.288026 (+127492us) service_pool.cc:227] Handling call
0929 11:36:58.341592 (+ 53566us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:58.442134 (+100542us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:58.450460 (+ 8326us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:58.495442 (+ 44982us) log.cc:842] Serialized 26 byte log entry
0929 11:36:59.413422 (+917980us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:59.413470 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.413548 (+ 78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:59.753381 (+339833us) raft_consensus.cc:1671] finished
0929 11:36:59.754464 (+ 1083us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:59.760601 (+ 6137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1705,"raft.queue_time_us":11662,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":45336,"thread_start_us":869506,"threads_started":1,"wal-append.queue_time_us":720954}
I20260929 11:37:00.005785 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.007827 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.782907 18348 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:00.013110 17463 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:36:59.991452 18217 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:36:59.995110 17234 rpcz_store.cc:276] 0929 11:36:57.033189 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.052840 (+ 19651us) service_pool.cc:227] Handling call
0929 11:36:57.053205 (+ 365us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:57.785171 (+731966us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.895680 (+2110509us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400701cd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:59.923886 (+ 28206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1029129984}
I20260929 11:37:00.033195 18375 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.060885 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 242) took 1815 ms. Trace:
I20260929 11:37:00.061352 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 250) took 1168 ms. Trace:
I20260929 11:37:00.061421 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.062379 18375 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:00.062857 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:36:59.996515 18225 consensus_queue.cc:1035] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260929 11:37:00.063410 18311 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:36:59.896154 17236 rpcz_store.cc:276] 0929 11:36:58.310640 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.630491 (+1319851us) service_pool.cc:227] Handling call
0929 11:36:59.746875 (+116384us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:59.757638 (+ 10763us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:59.759423 (+ 1785us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:59.762574 (+ 3151us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:59.769143 (+ 6569us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.779027 (+ 9884us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:59.788230 (+ 9203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:36:59.781452 18345 consensus_queue.cc:237] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:36:59.978334 18289 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:00.042265 18161 consensus_meta.cc:287] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 1.329s user 0.006s sys 0.008s
I20260929 11:37:00.022792 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 209) took 1085 ms. Trace:
I20260929 11:37:00.034092 18366 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.035797 18179 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:00.065749 18371 raft_consensus.cc:2781] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:00.061906 17311 rpcz_store.cc:276] 0929 11:36:58.893032 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.894483 (+ 1451us) service_pool.cc:227] Handling call
0929 11:36:58.941082 (+ 46599us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:59.239074 (+297992us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:59.239119 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:59.239191 (+ 72us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:36:59.239242 (+ 51us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.061107 (+821865us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540007ce54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:00.061159 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.061291 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":672422272}
I20260929 11:37:00.072996 18371 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.073361 18371 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:00.058432 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 66544.5us
I20260929 11:37:00.058573 18217 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:00.074622 18174 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:00.059872 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.054765 17318 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:36:59.731627 17383 rpcz_store.cc:276] 0929 11:36:58.332679 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.742253 (+409574us) service_pool.cc:227] Handling call
0929 11:36:58.749896 (+ 7643us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:58.777637 (+ 27741us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:58.777690 (+ 53us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:58.787287 (+ 9597us) log.cc:842] Serialized 26 byte log entry
0929 11:36:59.312831 (+525544us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:36:59.463613 (+150782us) log.cc:842] Serialized 14 byte log entry
0929 11:36:59.521671 (+ 58058us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.529448 (+ 7777us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:36:59.531260 (+ 1812us) raft_consensus.cc:1671] finished
0929 11:36:59.531288 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:36:59.546849 (+ 15561us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":127162,"prepare.queue_time_us":70295,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":75815,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":30517,"thread_start_us":456767,"threads_started":1,"wal-append.queue_time_us":511459}
I20260929 11:37:00.063036 17460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 196) took 2943 ms. Trace:
I20260929 11:37:00.063544 17310 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:00.009696 18240 consensus_queue.cc:1035] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260929 11:37:00.060925 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:37:00.045747 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 86228.8us
I20260929 11:37:00.064520 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:00.051671 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.038846 18357 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.071242 17309 raft_consensus.cc:2396] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260929 11:37:00.061321 17241 rpcz_store.cc:276] 0929 11:36:58.245833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.544844 (+1299011us) service_pool.cc:227] Handling call
0929 11:36:59.726780 (+181936us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:59.808454 (+ 81674us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:59.808504 (+ 50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:59.811053 (+ 2549us) log.cc:842] Serialized 26 byte log entry
0929 11:36:59.956460 (+145407us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:59.958226 (+ 1766us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.963923 (+ 5697us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:00.060657 (+ 96734us) raft_consensus.cc:1671] finished
0929 11:37:00.060675 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.060825 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":75433,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":1936256,"thread_start_us":137773,"threads_started":2,"wal-append.queue_time_us":183910}
I20260929 11:37:00.060156 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.096204 17234 raft_consensus.cc:2379] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:00.085333 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.096791 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.097496 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.098057 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.098286 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.098794 17235 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:37:00.099747 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:00.100138 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.100637 18350 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:00.101197 18348 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:00.101806 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.102618 17464 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:00.078940 17207 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:00.086165 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.068482 18341 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.096287 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.069849 18161 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.098146 17234 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:00.074750 18217 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.044977 18365 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.069878 18313 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.104607 17357 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:00.101817 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.106205 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.079643 18298 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:00.102936 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.110833 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.111562 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.115428 17357 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:00.115890 18341 raft_consensus.cc:2726] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:00.116206 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:00.084406 17236 raft_consensus.cc:3037] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.117708 17431 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.070091 17392 rpcz_store.cc:276] 0929 11:36:58.937076 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.756706 (+819630us) service_pool.cc:227] Handling call
0929 11:37:00.016257 (+259551us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.124156 18161 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.130748 17206 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.130919 17431 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:00.133371 17431 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:00.133894 17208 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:00.134464 17206 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.128551 18270 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.137905 17206 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.141714 17429 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.142735 18269 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.143332 18269 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.143683 18269 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.143802 18357 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:00.142810 18174 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.118999 18379 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.140924 18012 raft_consensus.cc:2781] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:00.131776 17309 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:00.125195 18298 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.141271 18348 raft_consensus.cc:2781] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:00.133039 17234 raft_consensus.cc:3037] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.142788 18240 raft_consensus.cc:2781] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:37:00.163091 18297 log.cc:924] Time spent T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 2.382s user 0.017s sys 0.017s
I20260929 11:37:00.163362 18240 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:00.163854 18240 raft_consensus.cc:3037] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:37:00.152792 18377 log.cc:924] Time spent T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.229s user 0.003s sys 0.000s
I20260929 11:37:00.144999 18161 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.079520 17460 rpcz_store.cc:276] 0929 11:36:57.119663 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.121338 (+ 1675us) service_pool.cc:227] Handling call
0929 11:36:57.957546 (+836208us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b580004c898. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:36:57.957804 (+ 258us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:58.034824 (+ 77020us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:36:58.037950 (+ 3126us) log.cc:842] Serialized 14 byte log entry
0929 11:36:58.317434 (+279484us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:58.321699 (+ 4265us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:36:58.327871 (+ 6172us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.062773 (+1734902us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b54006a40d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:00.062828 (+ 55us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.062957 (+ 129us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":2131,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":47007,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":27410,"spinlock_wait_cycles":154888960,"thread_start_us":249494,"threads_started":1,"wal-append.queue_time_us":484050,"wal-append.run_cpu_time_us":2996,"wal-append.run_wall_time_us":1350171}
I20260929 11:37:00.132790 18179 raft_consensus.cc:2726] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:00.153000 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.150125 18012 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:37:00.165071 18376 log.cc:924] Time spent T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.120s user 0.001s sys 0.000s
I20260929 11:37:00.147943 18174 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.154649 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 187) took 2675 ms. Trace:
I20260929 11:37:00.155933 17429 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.157076 17313 raft_consensus.cc:1226] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:00.127099 17310 raft_consensus.cc:2454] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:37:00.147261 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.145906 18345 raft_consensus.cc:2726] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:00.157977 18348 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.162688 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.182324 18348 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.182226 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.182699 17386 raft_consensus.cc:2379] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:00.171653 18289 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.182996 18133 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.172588 18012 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.149470 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.147235 18379 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.168125 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.169092 17238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 207) took 3066 ms. Trace:
I20260929 11:37:00.170717 18268 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.193200 18268 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:00.194247 17465 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:00.195401 18268 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:37:00.169288 18283 log.cc:924] Time spent T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 2.388s user 0.018s sys 0.020s
I20260929 11:37:00.165241 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.176517 18179 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260929 11:37:00.177394 17243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 216) took 2135 ms (client timeout 2031 ms). Trace:
I20260929 11:37:00.172780 18275 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.173815 18174 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.178397 17240 raft_consensus.cc:1226] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:00.179451 18298 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.167187 18161 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:00.171998 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.128813 17383 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:00.183715 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.217792 17236 raft_consensus.cc:2454] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:00.211239 18313 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:00.223451 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 216) took 1275 ms. Trace:
I20260929 11:37:00.223841 18313 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.224366 17357 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:00.180003 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.225417 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.166225 17457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 275) took 2712 ms. Trace:
I20260929 11:37:00.191231 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.226013 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:37:00.226590 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 199) took 2002 ms (client timeout 1915 ms). Trace:
I20260929 11:37:00.186952 17429 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.192093 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 242) took 1981 ms. Trace:
I20260929 11:37:00.227041 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.227330 17314 rpcz_store.cc:276] 0929 11:36:58.211200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.211340 (+ 140us) service_pool.cc:227] Handling call
0929 11:36:58.237038 (+ 25698us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:58.294173 (+ 57135us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.191854 (+1897681us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b54000fcdd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:00.192037 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":115485056}
I20260929 11:37:00.153594 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:00.228057 18247 raft_consensus.cc:2781] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260929 11:37:00.228149 17458 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32868 (request call id 171) took 2358 ms (client timeout 2069 ms). Trace:
I20260929 11:37:00.228807 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 210) took 1291 ms. Trace:
I20260929 11:37:00.229135 18342 raft_consensus.cc:2781] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:00.229740 18342 raft_consensus.cc:686] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:00.218240 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.230176 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:00.228657 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.183230 17386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 203) took 1914 ms. Trace:
I20260929 11:37:00.185606 18133 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.173615 17317 rpcz_store.cc:276] 0929 11:36:57.478835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.567839 (+ 89004us) service_pool.cc:227] Handling call
0929 11:36:57.652888 (+ 85049us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:57.899252 (+246364us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:57.903819 (+ 4567us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:57.926773 (+ 22954us) log.cc:842] Serialized 26 byte log entry
0929 11:36:58.391209 (+464436us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:58.391281 (+ 72us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.154211 (+1762930us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b54005c9c54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:00.154261 (+ 50us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:00.154327 (+ 66us) raft_consensus.cc:1671] finished
0929 11:37:00.154342 (+ 15us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.154559 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11875,"raft.queue_time_us":22136,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8563,"spinlock_wait_cycles":69184384,"thread_start_us":506537,"threads_started":2,"wal-append.queue_time_us":540597,"wal-append.run_cpu_time_us":3342,"wal-append.run_wall_time_us":1295727}
I20260929 11:37:00.237082 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.237700 18365 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.196470 17311 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.213385 17463 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:00.238343 17317 raft_consensus.cc:2396] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:00.239765 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.232210 17314 raft_consensus.cc:2379] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
W20260929 11:37:00.208632 17243 rpcz_store.cc:269] 0929 11:36:58.042268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.043408 (+ 1140us) service_pool.cc:227] Handling call
0929 11:37:00.177167 (+2133759us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400046354. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:00.177302 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":417847168}
W20260929 11:37:00.212179 17239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 222) took 1896 ms (client timeout 1573 ms). Trace:
I20260929 11:37:00.221800 18161 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.226197 17457 rpcz_store.cc:276] 0929 11:36:57.453461 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.543498 (+ 90037us) service_pool.cc:227] Handling call
0929 11:36:57.543830 (+ 332us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:57.931393 (+387563us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.165936 (+2234543us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54004164d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:00.166162 (+ 226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":574620928}
I20260929 11:37:00.196003 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 238) took 1987 ms. Trace:
I20260929 11:37:00.229537 17392 rpcz_store.cc:276] 0929 11:36:58.937381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.151097 (+1213716us) service_pool.cc:227] Handling call
0929 11:37:00.228751 (+ 77654us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.223851 17383 rpcz_store.cc:276] 0929 11:36:58.948363 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.105836 (+1157473us) service_pool.cc:227] Handling call
0929 11:37:00.223378 (+117542us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.183009 17316 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:37:00.204986 18179 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.234225 17386 rpcz_store.cc:276] 0929 11:36:58.268567 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.277478 (+ 8911us) service_pool.cc:227] Handling call
0929 11:37:00.162557 (+1885079us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.183170 (+ 20613us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17626880}
I20260929 11:37:00.226655 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:00.280052 18275 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:00.277757 18298 consensus_queue.cc:1035] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260929 11:37:00.281303 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.249828 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:00.227065 17390 rpcz_store.cc:269] 0929 11:36:58.223795 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.224684 (+ 889us) service_pool.cc:227] Handling call
0929 11:37:00.191123 (+1966439us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.226529 (+ 35406us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16958720}
I20260929 11:37:00.175765 18366 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:00.283458 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.284075 17390 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:00.284528 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 214) took 1342 ms. Trace:
I20260929 11:37:00.284790 17390 rpcz_store.cc:276] 0929 11:36:58.942357 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.283186 (+1340829us) service_pool.cc:227] Handling call
0929 11:37:00.284477 (+ 1291us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.247814 17206 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.190946 17238 rpcz_store.cc:276] 0929 11:36:57.102906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.563281 (+460375us) service_pool.cc:227] Handling call
0929 11:36:57.768290 (+205009us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:57.960351 (+192061us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.168841 (+2208490us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003967d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:00.169031 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":348053760}
I20260929 11:37:00.214545 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.286646 17310 raft_consensus.cc:2379] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:00.286733 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:00.286958 17206 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.287397 17238 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.287499 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:37:00.250662 17239 rpcz_store.cc:269] 0929 11:36:58.315973 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.788533 (+472560us) service_pool.cc:227] Handling call
0929 11:37:00.211988 (+1423455us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b5400106b54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:00.212110 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16016640}
W20260929 11:37:00.230662 17385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 201) took 1988 ms (client timeout 1990 ms). Trace:
W20260929 11:37:00.228729 17458 rpcz_store.cc:269] 0929 11:36:57.869836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.880346 (+ 10510us) service_pool.cc:227] Handling call
0929 11:37:00.226899 (+2346553us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b580004c898. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.228062 (+ 1163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4547328}
I20260929 11:37:00.250144 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.246150 18307 consensus_queue.cc:1046] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260929 11:37:00.253721 17318 raft_consensus.cc:2396] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:00.226047 18313 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.251456 17462 raft_consensus.cc:1261] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:00.200518 18379 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.298563 17208 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.269603 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 207) took 1966 ms. Trace:
I20260929 11:37:00.270602 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.275871 18179 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.254587 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.279348 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.282440 17460 raft_consensus.cc:2379] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:00.285610 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.228632 18247 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.290831 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.230664 18342 consensus_queue.cc:237] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.254680 18304 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:00.244731 17236 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.316628 17429 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.288792 18236 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:00.318681 17389 rpcz_store.cc:276] 0929 11:36:58.303363 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.589703 (+286340us) service_pool.cc:227] Handling call
0929 11:37:00.269303 (+1679600us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003a20d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:00.269521 (+ 218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1879493504}
I20260929 11:37:00.294059 18294 raft_consensus.cc:2726] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:00.330825 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.294626 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48800 (request call id 182) took 1239 ms. Trace:
I20260929 11:37:00.331689 17466 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:00.333170 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 198) took 1439 ms. Trace:
I20260929 11:37:00.316020 18080 raft_consensus.cc:2726] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:37:00.337344 17314 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.320128 18307 consensus_queue.cc:1225] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer a7e500c82a21469ab59f66205205a12a log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260929 11:37:00.316257 17464 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:00.289996 18348 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.257544 17313 rpcz_store.cc:276] 0929 11:36:58.203878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.214979 (+ 11101us) service_pool.cc:227] Handling call
0929 11:37:00.156676 (+1941697us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:00.156905 (+ 229us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.180494 (+ 23589us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.191061 (+ 10567us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12052864}
I20260929 11:37:00.354624 17282 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.359536 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.355933 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.339005 17311 raft_consensus.cc:2396] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:00.332952 18263 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.356621 17356 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:00.332991 18247 raft_consensus.cc:3037] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.333134 17235 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:00.361238 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 159) took 1437 ms. Trace:
I20260929 11:37:00.290174 18368 consensus_queue.cc:1046] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260929 11:37:00.333676 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 181) took 1697 ms. Trace:
W20260929 11:37:00.289203 17385 rpcz_store.cc:269] 0929 11:36:58.242429 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.246533 (+ 4104us) service_pool.cc:227] Handling call
0929 11:37:00.218025 (+1971492us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.230598 (+ 12573us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":37503872}
I20260929 11:37:00.355005 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 217) took 2043 ms. Trace:
I20260929 11:37:00.382710 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.338589 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.370240 17207 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.364696 18313 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.376140 17389 rpcz_store.cc:276] 0929 11:36:58.924297 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.335893 (+1411596us) service_pool.cc:227] Handling call
0929 11:37:00.361187 (+ 25294us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.395821 17429 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.368791 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.365134 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.335348 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.335693 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.355577 18275 raft_consensus.cc:2726] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:00.381147 18365 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:00.434706 17314 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:00.464484 17355 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:00.356680 17316 rpcz_store.cc:276] 0929 11:36:59.051562 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.787757 (+736195us) service_pool.cc:227] Handling call
0929 11:37:00.180304 (+392547us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.291275 (+110971us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35414400}
I20260929 11:37:00.356040 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.363125 18366 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:00.369380 17387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 146) took 2159 ms (client timeout 1585 ms). Trace:
I20260929 11:37:00.385025 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.385989 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.387761 18131 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.380553 18299 raft_consensus.cc:3037] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.339255 18236 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:00.381175 18217 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.406258 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.406373 18080 raft_consensus.cc:3032] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
W20260929 11:37:00.390561 17461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32868 (request call id 183) took 1755 ms (client timeout 1605 ms). Trace:
I20260929 11:37:00.356478 17390 rpcz_store.cc:276] 0929 11:36:58.893950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.285359 (+1391409us) service_pool.cc:227] Handling call
0929 11:37:00.333111 (+ 47752us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.393086 17357 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:00.383836 17313 raft_consensus.cc:2396] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260929 11:37:00.380941 18371 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.394517 18294 raft_consensus.cc:2726] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:00.396494 18346 consensus_queue.cc:1046] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260929 11:37:00.499689 17312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 245) took 2287 ms. Trace:
I20260929 11:37:00.500656 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.501459 18371 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:00.501650 17313 raft_consensus.cc:2396] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:00.405144 17234 raft_consensus.cc:2454] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:00.464251 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.463234 18268 raft_consensus.cc:2726] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:37:00.396970 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:00.409250 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 212) took 3304 ms. Trace:
I20260929 11:37:00.475067 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.394654 18197 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:00.407768 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.469177 18365 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:00.470649 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 198) took 2247 ms (client timeout 1587 ms). Trace:
I20260929 11:37:00.403993 18012 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:00.469576 17283 connection.cc:232] RPC call timeout handler was delayed by -1.3071738169999207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260929 11:37:00.512230 17283 connection.cc:232] RPC call timeout handler was delayed by -1.005673816999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260929 11:37:00.512665 17283 connection.cc:232] RPC call timeout handler was delayed by -1.005673816999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260929 11:37:00.503273 17429 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.505563 17460 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:00.503921 17206 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.499238 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.515868 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.480000 17457 raft_consensus.cc:2454] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:37:00.471239 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.469646 18145 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.469429 18285 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:00.336853 18304 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.409582 18313 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:00.508615 17242 rpcz_store.cc:276] 0929 11:36:57.104463 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.791979 (+687516us) service_pool.cc:227] Handling call
0929 11:36:57.833102 (+ 41123us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:57.889202 (+ 56100us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:57.889236 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:36:57.889276 (+ 40us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:57.889312 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:36:59.487173 (+1597861us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b540046b9d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:36:59.487219 (+ 46us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.409075 (+921856us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b540046b9d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:00.409192 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":198033536}
I20260929 11:37:00.468787 17383 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:00.477337 18341 raft_consensus.cc:2781] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
W20260929 11:37:00.496682 17461 rpcz_store.cc:269] 0929 11:36:58.634644 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.647502 (+ 12858us) service_pool.cc:227] Handling call
0929 11:37:00.390351 (+1742849us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b5400030554. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:00.390471 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":113079168}
I20260929 11:37:00.389647 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.408674 18240 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.497020 18080 raft_consensus.cc:729] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:00.513964 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.514214 17429 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.520450 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 239) took 2314 ms. Trace:
I20260929 11:37:00.499133 17385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 162) took 1175 ms. Trace:
I20260929 11:37:00.447281 18269 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:00.500131 17312 rpcz_store.cc:276] 0929 11:36:58.212249 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.288057 (+ 75808us) service_pool.cc:227] Handling call
0929 11:36:58.308475 (+ 20418us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:36:58.468273 (+159798us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:36:58.468311 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:36:58.471855 (+ 3544us) log.cc:842] Serialized 26 byte log entry
0929 11:36:58.546076 (+ 74221us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:36:58.546129 (+ 53us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.499323 (+1953194us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54005ca654. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:00.499372 (+ 49us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:00.499416 (+ 44us) raft_consensus.cc:1671] finished
0929 11:37:00.499428 (+ 12us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.499637 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":276,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":359414528,"thread_start_us":73766,"threads_started":1,"wal-append.queue_time_us":409575}
W20260929 11:37:00.512027 17388 rpcz_store.cc:269] 0929 11:36:58.223374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.224848 (+ 1474us) service_pool.cc:227] Handling call
0929 11:37:00.364522 (+2139674us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.470576 (+106054us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7167872}
I20260929 11:37:00.552085 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.552932 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.553755 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 164) took 1102 ms. Trace:
I20260929 11:37:00.553928 18240 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:00.554128 17388 rpcz_store.cc:276] 0929 11:36:59.451593 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.552653 (+1101060us) service_pool.cc:227] Handling call
0929 11:37:00.553698 (+ 1045us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.543838 18182 raft_consensus.cc:2726] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:00.543764 17385 rpcz_store.cc:276] 0929 11:36:59.323817 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.385679 (+1061862us) service_pool.cc:227] Handling call
0929 11:37:00.499056 (+113377us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:00.541627 17383 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 197) took 1648 ms (client timeout 2156 ms). Trace:
I20260929 11:37:00.557940 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.555629 18341 raft_consensus.cc:686] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:00.559428 18341 consensus_queue.cc:237] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:00.555250 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.406821 18161 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.516987 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.513268 17464 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.518496 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:00.593526 17389 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.382090 17462 rpcz_store.cc:276] 0929 11:36:58.633978 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.876233 (+242255us) service_pool.cc:227] Handling call
0929 11:37:00.250937 (+1374704us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b580004c898. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:00.251089 (+ 152us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.316442 (+ 65353us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.331767 (+ 15325us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9477504}
I20260929 11:37:00.512524 17317 raft_consensus.cc:2396] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:00.518599 17282 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:37:00.596009 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 77480.7us
I20260929 11:37:00.507346 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:00.598869 17431 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.538753 18348 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.510505 18366 raft_consensus.cc:2781] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260929 11:37:00.557760 17383 rpcz_store.cc:269] 0929 11:36:58.891792 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.293565 (+1401773us) service_pool.cc:227] Handling call
0929 11:37:00.540555 (+246990us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.524416 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.607739 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.608287 17234 raft_consensus.cc:2379] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:00.608569 18174 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:00.609095 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.515580 18268 raft_consensus.cc:2726] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:00.511857 18197 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:00.610286 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.610888 17461 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:00.611263 18197 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:00.525331 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.611732 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.611905 17282 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.513864 18307 raft_consensus.cc:3032] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:00.612752 18307 raft_consensus.cc:729] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:00.613293 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.614123 17235 raft_consensus.cc:2354] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4.
I20260929 11:37:00.613725 18307 consensus_queue.cc:260] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:00.614779 18307 raft_consensus.cc:3037] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.603264 18366 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.615389 18366 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.504766 17311 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:00.617007 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.617393 17461 raft_consensus.cc:1226] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:00.617588 17311 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.618165 17461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 187) took 1102 ms. Trace:
I20260929 11:37:00.618824 17461 rpcz_store.cc:276] 0929 11:36:59.515571 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.616830 (+1101259us) service_pool.cc:227] Handling call
0929 11:37:00.617152 (+ 322us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.617875 (+ 723us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.618099 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.489848 18133 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:00.533878 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.620782 17460 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:37:00.400497 18229 consensus_queue.cc:260] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:00.533949 18365 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:00.532943 18285 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.535813 17459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 169) took 2686 ms. Trace:
I20260929 11:37:00.391891 17239 rpcz_store.cc:276] 0929 11:36:58.311141 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.288351 (+1977210us) service_pool.cc:227] Handling call
0929 11:37:00.294205 (+ 5854us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.317789 (+ 23584us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:00.319084 (+ 1295us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:00.329026 (+ 9942us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.331573 (+ 2547us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.335496 (+ 3923us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.352249 (+ 16753us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.518590 18371 raft_consensus.cc:2726] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:00.539553 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 241) took 2294 ms. Trace:
I20260929 11:37:00.625866 17240 rpcz_store.cc:276] 0929 11:36:58.245543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.536722 (+1291179us) service_pool.cc:227] Handling call
0929 11:37:00.178180 (+641458us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:00.218561 (+ 40381us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.537362 (+318801us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b5400046350. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:00.539482 (+ 2120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1474370816}
I20260929 11:37:00.541720 17313 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:00.620889 17461 raft_consensus.cc:1226] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260929 11:37:00.506021 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 113011us
I20260929 11:37:00.614538 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.600292 17356 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:37:00.480712 17387 rpcz_store.cc:269] 0929 11:36:58.200729 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.224290 (+ 23561us) service_pool.cc:227] Handling call
0929 11:37:00.267490 (+2043200us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.356172 (+ 88682us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8188288}
I20260929 11:37:00.515413 17310 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:00.607141 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.604693 18182 raft_consensus.cc:2726] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:00.607275 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.612665 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.609098 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.534274 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.527295 18145 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:00.623313 17429 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.624588 17282 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.582918 17238 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:00.543715 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:37:00.689931 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 66686.9us
I20260929 11:37:00.690433 17242 raft_consensus.cc:2379] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:00.596884 18240 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.627030 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.629069 18197 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260929 11:37:00.605804 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 192) took 1726 ms (client timeout 2031 ms). Trace:
I20260929 11:37:00.522794 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.537211 18313 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:00.607290 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 156) took 2264 ms (client timeout 1756 ms). Trace:
I20260929 11:37:00.637483 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.705695 17313 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:37:00.639815 17357 leader_election.cc:302] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.626255 18174 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:00.642488 18365 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260929 11:37:00.687806 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 63279.5us
I20260929 11:37:00.627585 17459 rpcz_store.cc:276] 0929 11:36:57.849751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:57.926786 (+ 77035us) service_pool.cc:227] Handling call
0929 11:36:57.938560 (+ 11774us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:58.897172 (+958612us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.535560 (+1638388us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b5400574ed4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:00.535754 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1979058944}
I20260929 11:37:00.628988 18269 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:37:00.694793 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 175485us
I20260929 11:37:00.634058 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.636526 18133 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:00.719988 18133 consensus_queue.cc:1035] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:00.713038 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.720820 17311 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:00.716239 18016 raft_consensus.cc:2781] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:00.721401 18133 consensus_queue.cc:1035] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:00.721868 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.722082 18016 raft_consensus.cc:686] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:00.684463 17309 raft_consensus.cc:2379] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 4: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:00.633718 18315 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:00.723630 18389 log.cc:924] Time spent T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.126s user 0.000s sys 0.000s
I20260929 11:37:00.723538 18315 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.696022 18182 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:00.704269 17240 raft_consensus.cc:1226] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:00.728680 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 244) took 2407 ms. Trace:
I20260929 11:37:00.729094 17240 rpcz_store.cc:276] 0929 11:36:58.321755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.698762 (+2377007us) service_pool.cc:227] Handling call
0929 11:37:00.699201 (+ 439us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.728411 (+ 29210us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.728628 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.629310 18080 consensus_queue.cc:260] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.708487 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.708784 17239 raft_consensus.cc:1226] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
W20260929 11:37:00.693518 17392 rpcz_store.cc:269] 0929 11:36:58.877350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.314106 (+1436756us) service_pool.cc:227] Handling call
0929 11:37:00.389488 (+ 75382us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.603461 (+213973us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3985664}
I20260929 11:37:00.707206 17312 raft_consensus.cc:2454] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 1.
I20260929 11:37:00.697010 18247 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:37:00.711228 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 71562.3us
I20260929 11:37:00.685063 18236 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:00.696271 18270 consensus_meta.cc:287] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.551s user 0.005s sys 0.005s
I20260929 11:37:00.713835 17429 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:00.686899 18012 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:00.715502 17206 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.689926 18259 raft_consensus.cc:2781] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:00.723083 18016 consensus_queue.cc:237] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:00.723788 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.637679 18302 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.634287 18346 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:00.719416 17283 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
W20260929 11:37:00.766050 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 46684.8us
I20260929 11:37:00.767277 17283 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:00.696272 18361 raft_consensus.cc:3032] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:00.718138 17317 raft_consensus.cc:2396] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:00.725051 17458 raft_consensus.cc:2379] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 4: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:00.724514 17462 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:00.713228 18365 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.758699 18161 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:00.706579 17236 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:00.731009 18182 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.740983 17464 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:00.741114 17459 raft_consensus.cc:1226] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:00.731185 18269 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:00.741603 18145 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:00.742364 18366 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.723102 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.743345 18313 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.744915 17316 raft_consensus.cc:2379] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
W20260929 11:37:00.705461 17391 rpcz_store.cc:269] 0929 11:36:58.342682 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.607055 (+2264373us) service_pool.cc:214] Skipping call since client already timed out
0929 11:37:00.607198 (+ 143us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260929 11:37:00.626924 18229 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.697292 18240 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.787750 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.788224 18240 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:00.789036 17311 raft_consensus.cc:2396] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:00.789703 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48786 (request call id 192) took 1267 ms. Trace:
I20260929 11:37:00.789911 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.790138 17316 rpcz_store.cc:276] 0929 11:36:59.521963 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.704911 (+1182948us) service_pool.cc:227] Handling call
0929 11:37:00.789647 (+ 84736us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.791183 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.791556 17311 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:00.792223 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 251) took 1885 ms. Trace:
I20260929 11:37:00.544885 17315 rpcz_store.cc:276] 0929 11:36:58.204272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.215041 (+ 10769us) service_pool.cc:227] Handling call
0929 11:37:00.330475 (+2115434us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:00.330651 (+ 176us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.338552 (+ 7901us) raft_consensus.cc:1520] Early marking committed up to index 1
0929 11:37:00.359364 (+ 20812us) log.cc:842] Serialized 14 byte log entry
0929 11:37:00.504484 (+145120us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:00.507311 (+ 2827us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.511480 (+ 4169us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.513253 (+ 1773us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.518808 (+ 5555us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":20756,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":6958,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3489,"spinlock_wait_cycles":5268224,"thread_start_us":122604,"threads_started":1,"wal-append.queue_time_us":177115}
I20260929 11:37:00.792446 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.792593 17311 rpcz_store.cc:276] 0929 11:36:58.906891 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.790989 (+1884098us) service_pool.cc:227] Handling call
0929 11:37:00.791316 (+ 327us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:00.791976 (+ 660us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.792173 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.793732 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.793900 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 252) took 1886 ms. Trace:
I20260929 11:37:00.794265 17315 rpcz_store.cc:276] 0929 11:36:58.907567 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.793117 (+1885550us) service_pool.cc:227] Handling call
0929 11:37:00.793394 (+ 277us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.793581 (+ 187us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:00.793609 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:00.793651 (+ 42us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.793687 (+ 36us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.793741 (+ 54us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.793848 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.794895 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.795388 18366 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.795779 17315 raft_consensus.cc:1226] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260929 11:37:00.734817 18340 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.903s user 0.014s sys 0.016s
I20260929 11:37:00.733925 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:00.764851 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 51113.7us
I20260929 11:37:00.761224 18270 raft_consensus.cc:2726] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260929 11:37:00.765933 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 50504.2us
I20260929 11:37:00.748818 18304 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.736886 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 246) took 1805 ms. Trace:
I20260929 11:37:00.772884 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.770921 17283 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.810370 17240 rpcz_store.cc:276] 0929 11:36:58.931685 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.734214 (+1802529us) service_pool.cc:227] Handling call
0929 11:37:00.734626 (+ 412us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.736462 (+ 1836us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:00.736503 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:00.736561 (+ 58us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.736604 (+ 43us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.736681 (+ 77us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.736817 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.810860 17207 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.805730 17206 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.732911 18379 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.778483 17242 raft_consensus.cc:1226] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:00.779838 17282 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.769035 18348 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.784181 18285 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:37:00.804291 18340 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.972s user 0.014s sys 0.016s
I20260929 11:37:00.770126 18192 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.769390 18012 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.763370 18259 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.866240 18259 raft_consensus.cc:3037] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.866696 18299 raft_consensus.cc:2726] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:00.765401 18302 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.869300 18302 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.871312 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:00.871961 17463 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.768406 18361 raft_consensus.cc:729] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:00.872913 18361 consensus_queue.cc:260] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:00.874058 18361 raft_consensus.cc:3037] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.761333 18289 consensus_queue.cc:1046] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260929 11:37:00.826205 18145 raft_consensus.cc:2726] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:00.773203 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:00.830245 18240 raft_consensus.cc:2781] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:00.785919 17314 raft_consensus.cc:2379] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 4: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:00.779161 18182 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.773126 18391 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.886512 18240 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.886821 18391 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:00.887012 18240 raft_consensus.cc:3037] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.887257 18391 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.889125 18224 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.777457 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.892220 18080 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:00.893296 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:00.893906 17457 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:00.894192 18263 consensus_meta.cc:287] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.518s user 0.000s sys 0.017s
I20260929 11:37:00.894716 18263 raft_consensus.cc:2726] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:00.894814 18240 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:00.896735 18240 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:00.896790 18379 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:00.780215 18247 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:00.798214 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56190 (request call id 201) took 1643 ms. Trace:
I20260929 11:37:00.809564 17431 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
W20260929 11:37:00.900949 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 91425.6us
I20260929 11:37:00.901559 17431 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:00.903048 17207 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:00.796049 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.899490 18238 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:00.826838 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.768711 17238 raft_consensus.cc:1261] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260929 11:37:00.827554 17283 leader_election.cc:334] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Timed out: RequestConsensusVote RPC to 127.13.221.193:35361 timed out after 1.505s (SENT)
I20260929 11:37:00.828032 17429 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.828495 17206 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:00.761073 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.829576 18308 raft_consensus.cc:2726] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:00.794278 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 253) took 1886 ms. Trace:
I20260929 11:37:00.836553 17389 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:00.849545 17385 raft_consensus.cc:2379] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:00.843252 18318 consensus_queue.cc:1046] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260929 11:37:00.807951 18315 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.851536 18313 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:00.853041 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 248) took 1407 ms. Trace:
I20260929 11:37:00.854216 18217 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:00.848964 18012 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.830088 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.860283 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.863860 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:00.865455 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.843755 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:00.921271 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:00.921765 17466 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.875097 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 243) took 2553 ms. Trace:
I20260929 11:37:00.875607 17241 raft_consensus.cc:2379] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:00.783550 18269 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:00.830052 18348 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.923817 17386 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:00.814534 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:00.815553 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 254) took 1889 ms. Trace:
I20260929 11:37:00.881644 17390 raft_consensus.cc:2454] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:00.776700 18365 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.909395 17391 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:00.831110 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48800 (request call id 188) took 1582 ms. Trace:
I20260929 11:37:00.899935 17465 rpcz_store.cc:276] 0929 11:36:59.154687 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.167862 (+1013175us) service_pool.cc:227] Handling call
0929 11:37:00.798067 (+630205us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b5400059e54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:00.798162 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12622592}
I20260929 11:37:00.836911 17234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 247) took 1425 ms. Trace:
I20260929 11:37:00.774335 18346 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:00.906860 17240 raft_consensus.cc:2379] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
W20260929 11:37:00.907159 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 78732.3us
I20260929 11:37:00.907827 17283 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:00.831877 18174 consensus_queue.cc:1035] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260929 11:37:00.906023 17463 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
W20260929 11:37:00.908396 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 80451.8us
I20260929 11:37:00.964924 17282 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.966759 17206 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:00.829998 18393 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:00.905258 18268 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:00.905650 18379 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:00.907101 18247 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:00.909789 18263 raft_consensus.cc:2781] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:00.922291 17242 rpcz_store.cc:276] 0929 11:36:58.321458 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.697395 (+2375937us) service_pool.cc:227] Handling call
0929 11:37:00.776810 (+ 79415us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:00.812841 (+ 36031us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.874899 (+ 62058us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54007017d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:00.875040 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":153351424}
I20260929 11:37:00.920162 18012 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.774750 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 218) took 2458 ms. Trace:
I20260929 11:37:00.912825 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:00.910979 18240 raft_consensus.cc:2781] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:00.858721 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:00.920362 17238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 225) took 2213 ms. Trace:
I20260929 11:37:00.968206 17207 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:00.999167 17238 rpcz_store.cc:276] 0929 11:36:58.704722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.713453 (+2008731us) service_pool.cc:227] Handling call
0929 11:37:00.735220 (+ 21767us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.907725 (+172505us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.918336 (+ 10611us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.000046 18294 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:01.000306 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.000577 18294 raft_consensus.cc:686] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:00.969496 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:01.001348 17463 raft_consensus.cc:3037] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:00.910279 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 163) took 1487 ms. Trace:
I20260929 11:37:00.927642 18348 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:00.976775 17206 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.965365 17208 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.006491 17206 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
W20260929 11:37:00.979624 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 164459us
I20260929 11:37:00.981823 17466 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:00.982187 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.007884 17206 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
W20260929 11:37:00.931434 17386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 160) took 1696 ms (client timeout 1839 ms). Trace:
I20260929 11:37:00.931269 18275 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:00.976794 18192 raft_consensus.cc:2726] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:00.976670 18393 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.981432 18145 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:00.983188 18313 raft_consensus.cc:2726] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:37:00.915810 17236 rpcz_store.cc:276] 0929 11:36:59.445854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.784245 (+1338391us) service_pool.cc:227] Handling call
0929 11:37:00.812819 (+ 28574us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.843180 (+ 30361us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:00.852526 (+ 9346us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:00.852622 (+ 96us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.852689 (+ 67us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.852789 (+ 100us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.852956 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.981310 18318 raft_consensus.cc:2781] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:00.949604 17317 raft_consensus.cc:2454] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:37:00.997486 18161 raft_consensus.cc:2726] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:00.935737 17310 rpcz_store.cc:276] 0929 11:36:59.249062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.692123 (+1443061us) service_pool.cc:227] Handling call
0929 11:37:00.831048 (+138925us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.997853 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.108438 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:00.909418 17311 rpcz_store.cc:276] 0929 11:36:58.908402 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.793503 (+1885101us) service_pool.cc:227] Handling call
0929 11:37:00.793818 (+ 315us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.793978 (+ 160us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:00.794004 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:00.794042 (+ 38us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.794076 (+ 34us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.794130 (+ 54us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.794231 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.998615 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.002473 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.116194 17242 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:01.090474 18393 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.002755 17389 rpcz_store.cc:276] 0929 11:36:59.423269 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.509157 (+1085888us) service_pool.cc:227] Handling call
0929 11:37:00.910206 (+401049us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:00.927841 17315 rpcz_store.cc:276] 0929 11:36:58.926466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.795227 (+1868761us) service_pool.cc:227] Handling call
0929 11:37:00.795546 (+ 319us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:00.796211 (+ 665us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.808556 (+ 12345us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.008504 17240 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.117853 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.006628 17208 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:00.986347 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:00.990243 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.992871 18240 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:00.978034 17234 rpcz_store.cc:276] 0929 11:36:59.409890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.759153 (+1349263us) service_pool.cc:227] Handling call
0929 11:37:00.778932 (+ 19779us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.785494 (+ 6562us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:00.786654 (+ 1160us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:00.797438 (+ 10784us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.805268 (+ 7830us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.821391 (+ 16123us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:00.835173 (+ 13782us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.027248 18346 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:01.001605 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.006111 18371 raft_consensus.cc:2726] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:01.140496 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 226) took 1338 ms. Trace:
I20260929 11:37:01.114778 18361 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:00.986778 18379 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.141230 18361 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.140926 17243 rpcz_store.cc:276] 0929 11:36:59.802235 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.788815 (+986580us) service_pool.cc:227] Handling call
0929 11:37:00.789208 (+ 393us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:00.789442 (+ 234us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:00.789470 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:00.789945 (+ 475us) log.cc:842] Serialized 26 byte log entry
0929 11:37:00.913556 (+123611us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.913594 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.918152 (+ 4558us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:01.140199 (+222047us) raft_consensus.cc:1671] finished
0929 11:37:01.140231 (+ 32us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.140435 (+ 204us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":119096,"threads_started":1,"wal-append.queue_time_us":202642}
I20260929 11:37:01.142699 18379 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:01.032939 17237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 217) took 2990 ms. Trace:
I20260929 11:37:01.033792 18391 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.143384 18361 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:01.143111 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.105971 18269 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:01.008411 18238 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.010639 18373 raft_consensus.cc:2726] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:01.131067 18240 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:01.006374 17309 raft_consensus.cc:3037] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:01.037135 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:01.166909 17318 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:01.167613 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48776 (request call id 266) took 1100 ms. Trace:
I20260929 11:37:01.039080 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:01.010483 18182 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.168248 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.002079 17392 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:01.169652 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.038529 18340 consensus_queue.cc:1035] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:01.172540 17464 raft_consensus.cc:1226] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:01.174134 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.083860 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.175004 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.175395 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.085496 17463 raft_consensus.cc:2454] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
W20260929 11:37:01.086606 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 85968.1us
I20260929 11:37:01.176222 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:01.176618 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.176887 17314 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:01.176937 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:01.177244 17387 raft_consensus.cc:3037] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:01.177785 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:01.086859 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 79041.7us
I20260929 11:37:01.178421 17463 raft_consensus.cc:1226] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.179005 17314 raft_consensus.cc:1226] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:01.179579 18027 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:01.180048 17206 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:01.180106 18027 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.181149 18299 raft_consensus.cc:3032] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:01.181408 17206 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:01.008882 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:01.182535 18027 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:01.183601 17207 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:00.990065 17239 rpcz_store.cc:276] 0929 11:36:58.311384 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.637211 (+2325827us) service_pool.cc:227] Handling call
0929 11:37:00.708542 (+ 71331us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:00.759691 (+ 51149us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.769957 (+ 10266us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.184340 17357 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:01.184973 17312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48786 (request call id 204) took 1106 ms. Trace:
I20260929 11:37:01.184932 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.092399 18145 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:01.185824 18145 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:01.185884 17387 raft_consensus.cc:2454] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:01.186944 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 223) took 1105 ms. Trace:
I20260929 11:37:01.186899 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.187356 17390 rpcz_store.cc:276] 0929 11:37:00.081374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.595866 (+514492us) service_pool.cc:227] Handling call
0929 11:37:01.186788 (+590922us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54000b6dd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:01.186890 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":570509696}
I20260929 11:37:01.088275 17385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 221) took 1156 ms. Trace:
I20260929 11:37:01.001531 18294 consensus_queue.cc:237] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.188140 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.188426 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.189082 17387 raft_consensus.cc:2396] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:01.179046 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 194) took 1099 ms. Trace:
I20260929 11:37:01.189687 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 172) took 1087 ms. Trace:
I20260929 11:37:01.190115 17387 rpcz_store.cc:276] 0929 11:37:00.102594 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.187893 (+1085299us) service_pool.cc:227] Handling call
0929 11:37:01.189636 (+ 1743us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:01.098680 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 89660us
I20260929 11:37:01.190968 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.191102 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:00.989810 18263 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:01.191594 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 256) took 2240 ms. Trace:
I20260929 11:37:01.191845 18263 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:37:01.097824 18179 consensus_meta.cc:287] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.761s user 0.008s sys 0.003s
W20260929 11:37:01.123229 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 116687us
I20260929 11:37:01.192723 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.193027 18361 consensus_queue.cc:1046] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260929 11:37:01.096129 17384 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 202) took 2135 ms (client timeout 1670 ms). Trace:
I20260929 11:37:01.194090 18361 raft_consensus.cc:2726] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:01.194344 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.192651 18179 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.194996 17355 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:01.195076 18016 consensus_queue.cc:1046] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:01.195521 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:01.137473 18395 log.cc:924] Time spent T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.150s user 0.001s sys 0.000s
I20260929 11:37:01.196570 18179 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:01.197009 18315 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:01.196653 18335 raft_consensus.cc:3032] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:01.188477 17385 rpcz_store.cc:276] 0929 11:36:59.932080 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.557639 (+625559us) service_pool.cc:227] Handling call
0929 11:37:01.028923 (+471284us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54004c9fd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:01.086441 (+ 57518us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":523455232}
I20260929 11:37:01.197800 18335 raft_consensus.cc:729] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:01.139757 18229 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:01.198278 18307 raft_consensus.cc:3032] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:01.198711 18307 raft_consensus.cc:729] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:01.198581 18229 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.199159 17207 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:01.199572 18307 consensus_queue.cc:260] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.200891 18307 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.201149 18229 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:01.150518 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.202666 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.141252 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.203948 18269 raft_consensus.cc:2726] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:01.160944 18302 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:01.196391 17384 rpcz_store.cc:269] 0929 11:36:58.959706 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:59.479585 (+519879us) service_pool.cc:227] Handling call
0929 11:37:01.091240 (+1611655us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000b81d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:01.094802 (+ 3562us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":564568832}
I20260929 11:37:01.143275 17237 rpcz_store.cc:276] 0929 11:36:58.042683 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:58.045665 (+ 2982us) service_pool.cc:227] Handling call
0929 11:36:58.046087 (+ 422us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:36:59.049200 (+1003113us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.032592 (+1983392us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b5400045454. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:01.032851 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1716324224}
I20260929 11:37:01.149832 17316 raft_consensus.cc:2379] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 4: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:01.204850 18269 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:01.153313 18217 raft_consensus.cc:3032] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:01.197542 18315 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:01.206130 18315 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:01.203261 17234 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:01.206501 18217 raft_consensus.cc:729] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:01.091444 18275 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.132225 18310 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:01.102537 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.146449 18006 consensus_queue.cc:1046] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:01.160897 17310 raft_consensus.cc:1226] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.122903 17235 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:01.162945 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:01.087894 17386 rpcz_store.cc:269] 0929 11:36:59.235084 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.313697 (+1078613us) service_pool.cc:227] Handling call
0929 11:37:00.860070 (+546373us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:00.929451 (+ 69381us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5066496}
I20260929 11:37:01.103168 18318 raft_consensus.cc:686] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:01.094411 18259 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.149446 17457 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:01.181562 18299 raft_consensus.cc:729] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:01.189042 17390 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.188768 18348 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.192281 17391 raft_consensus.cc:2396] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:01.197332 17460 raft_consensus.cc:1226] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:01.139161 18365 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.147994 18391 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:01.205965 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.105108 17459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 193) took 1027 ms. Trace:
I20260929 11:37:01.239105 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.238332 17459 rpcz_store.cc:276] 0929 11:37:00.078045 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.792070 (+714025us) service_pool.cc:227] Handling call
0929 11:37:00.805387 (+ 13317us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:00.853685 (+ 48298us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:00.853737 (+ 52us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:00.854397 (+ 660us) log.cc:842] Serialized 26 byte log entry
0929 11:37:00.990414 (+136017us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:00.993143 (+ 2729us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:00.996187 (+ 3044us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:01.104868 (+108681us) raft_consensus.cc:1671] finished
0929 11:37:01.104894 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.105047 (+ 153us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":867,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":7860,"thread_start_us":126645,"threads_started":1,"wal-append.queue_time_us":232555}
I20260929 11:37:01.240569 17459 raft_consensus.cc:1226] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:01.240670 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.241237 17459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 208) took 1090 ms. Trace:
I20260929 11:37:01.101856 18197 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:01.241897 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.185422 17312 rpcz_store.cc:276] 0929 11:37:00.078222 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.551668 (+473446us) service_pool.cc:227] Handling call
0929 11:37:01.184814 (+633146us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54004024d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:01.184923 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":354751744}
I20260929 11:37:01.134648 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.242653 17237 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:01.241571 17459 rpcz_store.cc:276] 0929 11:37:00.150395 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.240035 (+1089640us) service_pool.cc:227] Handling call
0929 11:37:01.240370 (+ 335us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.240977 (+ 607us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.241186 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.243789 17237 raft_consensus.cc:1226] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.209622 17208 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:01.179600 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 193) took 1702 ms. Trace:
I20260929 11:37:01.210678 17206 leader_election.cc:302] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.246394 17237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 230) took 1434 ms. Trace:
I20260929 11:37:01.246784 18379 raft_consensus.cc:2726] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:01.246613 17314 rpcz_store.cc:276] 0929 11:36:59.477517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.178612 (+1701095us) service_pool.cc:227] Handling call
0929 11:37:01.178857 (+ 245us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.179406 (+ 549us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.179555 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.211550 17357 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:01.214363 17465 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:01.119984 18268 raft_consensus.cc:686] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:01.248215 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.248860 18268 consensus_queue.cc:237] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.217631 17389 raft_consensus.cc:2379] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 4: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:01.249794 18318 consensus_queue.cc:237] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.216046 17240 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:01.204656 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.196676 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.205464 18269 raft_consensus.cc:686] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:01.253414 17282 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:01.254738 18313 consensus_queue.cc:1046] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:01.217427 18310 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:01.255581 18313 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:01.255651 18310 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.256103 18313 raft_consensus.cc:686] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [term 4 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:01.167975 17318 rpcz_store.cc:276] 0929 11:37:00.067546 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.332526 (+264980us) service_pool.cc:227] Handling call
0929 11:37:01.036908 (+704382us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:01.167537 (+130629us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":45877504}
I20260929 11:37:01.198312 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.205421 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.144184 17243 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:01.287390 18217 consensus_queue.cc:260] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.288565 18217 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.290482 17392 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:01.293195 17140 catalog_manager.cc:5495] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af reported cstate change: term changed from 1 to 2, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 2 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260929 11:37:01.298830 17240 raft_consensus.cc:1226] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:01.227994 17466 raft_consensus.cc:2454] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:37:01.228112 18247 raft_consensus.cc:686] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:01.192028 17315 rpcz_store.cc:276] 0929 11:36:58.950931 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.130936 (+2180005us) service_pool.cc:227] Handling call
0929 11:37:01.189489 (+ 58553us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.189665 (+ 176us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.189694 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.189738 (+ 44us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:01.189777 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.189837 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.191423 (+ 1586us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b54004024d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:01.191537 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":58665856}
I20260929 11:37:01.218236 18373 raft_consensus.cc:2781] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:01.218607 18027 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:01.219030 18356 raft_consensus.cc:2781] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:01.203944 17388 raft_consensus.cc:2454] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:01.225328 18341 raft_consensus.cc:3032] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:01.310868 18341 raft_consensus.cc:729] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:01.310685 18247 consensus_queue.cc:237] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.307188 18356 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:01.312862 18356 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:37:01.314018 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 136196us
I20260929 11:37:01.314229 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.314746 18161 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:01.310715 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 171) took 1248 ms. Trace:
I20260929 11:37:01.315241 18161 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.315413 17388 rpcz_store.cc:276] 0929 11:37:00.062797 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.630955 (+568158us) service_pool.cc:227] Handling call
0929 11:37:00.863689 (+232734us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:01.310648 (+446959us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7278336}
I20260929 11:37:01.242120 18197 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:01.191639 17283 leader_election.cc:334] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 1.670s (SENT)
I20260929 11:37:01.299404 18379 raft_consensus.cc:2781] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:01.242960 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.311762 18341 consensus_queue.cc:260] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.323134 17389 raft_consensus.cc:1226] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.189766 17463 rpcz_store.cc:276] 0929 11:37:00.079292 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.177982 (+1098690us) service_pool.cc:227] Handling call
0929 11:37:01.178266 (+ 284us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.178806 (+ 540us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.178998 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.323606 18341 raft_consensus.cc:3037] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.324290 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:01.324944 17463 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:01.325363 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 296) took 1254 ms. Trace:
I20260929 11:37:01.254197 18269 consensus_queue.cc:237] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.325737 17464 rpcz_store.cc:276] 0929 11:37:00.070934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.785212 (+714278us) service_pool.cc:227] Handling call
0929 11:37:00.861979 (+ 76767us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b580004c898. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:00.862192 (+ 213us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.173017 (+310825us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.325146 (+152129us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400059e54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:01.325310 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":731178240}
I20260929 11:37:01.326992 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:01.327729 17464 raft_consensus.cc:2379] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 4: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:01.327294 18313 consensus_queue.cc:237] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.310581 17392 raft_consensus.cc:1261] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:01.244051 17429 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:37:01.328840 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 84912.5us
I20260929 11:37:01.314860 18238 raft_consensus.cc:2726] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:01.250608 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:01.329981 18403 raft_consensus.cc:2781] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:01.324681 18161 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:01.323721 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 195) took 2435 ms. Trace:
I20260929 11:37:01.264906 17355 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:01.330432 18403 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:01.325737 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:37:01.331620 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 66848.9us
I20260929 11:37:01.263298 18137 raft_consensus.cc:2781] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:01.271339 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.260538 18274 raft_consensus.cc:2726] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:01.276433 18365 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:01.276971 17313 raft_consensus.cc:1226] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:01.277511 17457 raft_consensus.cc:1226] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:37:01.235250 18182 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:01.257848 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.237111 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.220216 18012 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.198722 18335 consensus_queue.cc:260] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.280072 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:01.283564 17390 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:01.229622 17383 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:01.284514 17460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 291) took 1241 ms. Trace:
I20260929 11:37:01.285569 18259 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:01.233668 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 255) took 2287 ms. Trace:
I20260929 11:37:01.299686 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 231) took 1487 ms. Trace:
I20260929 11:37:01.298525 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 218) took 1453 ms. Trace:
I20260929 11:37:01.302992 18016 consensus_queue.cc:1046] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:01.246842 17237 rpcz_store.cc:276] 0929 11:36:59.812143 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.243314 (+1431171us) service_pool.cc:227] Handling call
0929 11:37:01.243617 (+ 303us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.246153 (+ 2536us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.246344 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.303843 17138 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41940 (request call id 61) took 8483 ms. Trace:
I20260929 11:37:01.318032 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:37:01.319253 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 127629us
I20260929 11:37:01.133013 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.318578 18027 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.314869 17315 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:01.403800 18402 log.cc:924] Time spent T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260929 11:37:01.403885 17237 raft_consensus.cc:1226] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:01.318813 17458 raft_consensus.cc:1226] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.321650 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:01.404695 17237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 249) took 1445 ms. Trace:
I20260929 11:37:01.405098 17237 rpcz_store.cc:276] 0929 11:36:59.959235 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.403254 (+1444019us) service_pool.cc:227] Handling call
0929 11:37:01.403647 (+ 393us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.404427 (+ 780us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.404641 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.406405 17237 raft_consensus.cc:1226] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.406481 17387 raft_consensus.cc:1226] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:37:01.305454 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:01.321940 18275 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:01.322347 17388 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:37:01.256652 18299 consensus_queue.cc:260] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:01.258322 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 46881.1us
I20260929 11:37:01.330416 17314 raft_consensus.cc:2379] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
W20260929 11:37:01.257990 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 48432.5us
I20260929 11:37:01.331360 18403 raft_consensus.cc:3037] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:01.411589 17208 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:01.263476 18192 raft_consensus.cc:3032] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:01.331082 17389 rpcz_store.cc:276] 0929 11:36:58.888299 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.322659 (+2434360us) service_pool.cc:227] Handling call
0929 11:37:01.322980 (+ 321us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.323513 (+ 533us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.323677 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.413552 17208 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:01.331842 17463 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:01.323757 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.352808 17356 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:37:01.410416 17283 leader_election.cc:334] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Timed out: RequestConsensusVote RPC to 127.13.221.193:35361 timed out after 2.033s (SENT)
I20260929 11:37:01.418685 17208 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:01.419036 17283 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.302608 17459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 211) took 1144 ms. Trace:
I20260929 11:37:01.359305 18371 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:01.332299 18131 raft_consensus.cc:2781] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:01.347318 18137 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:01.437518 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:01.438347 17463 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.328778 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48776 (request call id 259) took 2045 ms. Trace:
I20260929 11:37:01.360018 18379 raft_consensus.cc:686] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:01.396450 17240 rpcz_store.cc:276] 0929 11:36:59.812474 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.266711 (+1454237us) service_pool.cc:227] Handling call
0929 11:37:01.267128 (+ 417us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.299370 (+ 32242us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.299618 (+ 248us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.383020 17384 raft_consensus.cc:1226] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.377990 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 193) took 2497 ms. Trace:
I20260929 11:37:01.399130 17391 rpcz_store.cc:276] 0929 11:36:59.813686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.190704 (+1377018us) service_pool.cc:227] Handling call
0929 11:37:01.267352 (+ 76648us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.413399 18192 raft_consensus.cc:729] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:01.428309 18294 raft_consensus.cc:2781] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:01.426735 18259 raft_consensus.cc:2726] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260929 11:37:01.420801 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 68128.4us
I20260929 11:37:01.392719 18302 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:37:01.423754 17283 leader_election.cc:334] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361): Timed out: RequestConsensusVote RPC to 127.13.221.193:35361 timed out after 2.105s (SENT)
I20260929 11:37:01.346478 18373 raft_consensus.cc:686] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:01.426093 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.432514 18229 raft_consensus.cc:2781] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:01.380304 18145 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.431247 17462 raft_consensus.cc:1226] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.431422 17206 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.401068 17457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 196) took 1254 ms. Trace:
I20260929 11:37:01.402092 17309 raft_consensus.cc:2454] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:01.408967 17237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 250) took 1449 ms. Trace:
I20260929 11:37:01.443082 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 209) took 1289 ms. Trace:
I20260929 11:37:01.407516 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 199) took 2510 ms. Trace:
I20260929 11:37:01.410784 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:01.420629 18174 raft_consensus.cc:2781] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:01.424928 18235 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:01.446246 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.470273 17283 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
W20260929 11:37:01.477032 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:37:01.436203 18131 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:01.432978 18299 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.479724 17314 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:01.560302 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 136574us
I20260929 11:37:01.399925 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 204) took 1020 ms. Trace:
I20260929 11:37:01.443249 18137 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.396232 17310 rpcz_store.cc:276] 0929 11:36:58.944723 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.122857 (+2178134us) service_pool.cc:227] Handling call
0929 11:37:01.160533 (+ 37676us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.221397 (+ 60864us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.232192 (+ 10795us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.577306 18027 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:01.570089 17383 rpcz_store.cc:276] 0929 11:37:00.376493 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.162550 (+786057us) service_pool.cc:227] Handling call
0929 11:37:01.397149 (+234599us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:01.496192 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 64859us
I20260929 11:37:01.579304 17206 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.495613 17465 rpcz_store.cc:276] 0929 11:37:00.153872 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.257108 (+1103236us) service_pool.cc:227] Handling call
0929 11:37:01.257383 (+ 275us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.257558 (+ 175us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:01.257806 (+ 248us) log.cc:842] Serialized 14 byte log entry
0929 11:37:01.442751 (+184945us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.442801 (+ 50us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:01.442841 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.442914 (+ 73us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.443027 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":2434,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":2885,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3599,"thread_start_us":184615,"threads_started":1}
I20260929 11:37:01.446441 18348 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:01.580446 18181 raft_consensus.cc:2726] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:01.508133 17463 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:01.580966 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:01.581293 18145 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:01.581655 17465 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:01.581938 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 299) took 1404 ms. Trace:
I20260929 11:37:01.582297 17463 rpcz_store.cc:276] 0929 11:37:00.177525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.581194 (+1403669us) service_pool.cc:227] Handling call
0929 11:37:01.581469 (+ 275us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.581643 (+ 174us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.581667 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.581714 (+ 47us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:01.581745 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.581796 (+ 51us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.581889 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.495321 17237 rpcz_store.cc:276] 0929 11:36:59.959868 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.405853 (+1445985us) service_pool.cc:227] Handling call
0929 11:37:01.406183 (+ 330us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.406867 (+ 684us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.407075 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.583740 17463 raft_consensus.cc:1261] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260929 11:37:01.584301 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 218) took 1186 ms. Trace:
I20260929 11:37:01.584625 17463 rpcz_store.cc:276] 0929 11:37:00.398288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.583154 (+1184866us) service_pool.cc:227] Handling call
0929 11:37:01.583433 (+ 279us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.584069 (+ 636us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.584253 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.585084 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 190) took 2105 ms. Trace:
I20260929 11:37:01.570654 17311 raft_consensus.cc:1226] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.585696 17463 raft_consensus.cc:1226] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:01.585836 17235 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:01.586407 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 219) took 1187 ms. Trace:
I20260929 11:37:01.586740 17463 rpcz_store.cc:276] 0929 11:37:00.398929 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.585262 (+1186333us) service_pool.cc:227] Handling call
0929 11:37:01.585545 (+ 283us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.586203 (+ 658us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.586362 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.587325 17241 raft_consensus.cc:1226] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:01.588349 18356 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.588497 18379 consensus_queue.cc:237] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.589532 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.590426 18356 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:01.590817 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.585491 17318 rpcz_store.cc:276] 0929 11:36:59.479732 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.461410 (+1981678us) service_pool.cc:227] Handling call
0929 11:37:01.502824 (+ 41414us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.571338 (+ 68514us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.584769 (+ 13431us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.584823 (+ 54us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:01.584863 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.584927 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.585029 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.429190 17459 rpcz_store.cc:276] 0929 11:37:00.154466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.297311 (+1142845us) service_pool.cc:227] Handling call
0929 11:37:01.297794 (+ 483us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.298064 (+ 270us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.298109 (+ 45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.298171 (+ 62us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:01.298216 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.298278 (+ 62us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.298391 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.394340 17460 rpcz_store.cc:276] 0929 11:37:00.042921 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.689016 (+646095us) service_pool.cc:227] Handling call
0929 11:37:00.716414 (+ 27398us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.248419 (+532005us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.284223 (+ 35804us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54002c97d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:01.284449 (+ 226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1102489856}
I20260929 11:37:01.556218 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 254) took 1579 ms. Trace:
I20260929 11:37:01.597980 17282 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:01.598255 17240 rpcz_store.cc:276] 0929 11:36:59.976924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.548583 (+1571659us) service_pool.cc:227] Handling call
0929 11:37:01.555743 (+ 7160us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.555914 (+ 171us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.555942 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.555981 (+ 39us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:01.556008 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.556055 (+ 47us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.556164 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.503414 18080 raft_consensus.cc:2726] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:37:01.558768 17429 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:01.436465 18371 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.494601 18294 raft_consensus.cc:686] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:01.565575 18174 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:01.564276 17283 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:37:01.625880 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 61687.3us
I20260929 11:37:01.444815 17316 rpcz_store.cc:276] 0929 11:36:59.283575 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.790890 (+1507315us) service_pool.cc:227] Handling call
0929 11:37:01.328608 (+537718us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54005c9c54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:01.328727 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":811179392}
I20260929 11:37:01.489286 18229 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:01.463888 17392 rpcz_store.cc:276] 0929 11:36:58.878459 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.291577 (+2413118us) service_pool.cc:227] Handling call
0929 11:37:01.303727 (+ 12150us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.328535 (+ 24808us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.375019 (+ 46484us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.629900 17357 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
W20260929 11:37:01.575289 18405 log.cc:924] Time spent T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.142s user 0.000s sys 0.001s
I20260929 11:37:01.445665 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 194) took 2565 ms. Trace:
I20260929 11:37:01.569626 18259 raft_consensus.cc:2726] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:01.594983 17463 raft_consensus.cc:1226] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.400887 17138 rpcz_store.cc:276] 0929 11:36:52.815466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:52.815611 (+ 145us) service_pool.cc:227] Handling call
0929 11:37:01.298657 (+8483046us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0929 11:36:58.781934 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0929 11:36:58.940899 (+158965us) write_op.cc:432] Acquiring schema lock in shared mode
0929 11:36:58.943847 (+ 2948us) write_op.cc:435] Acquired schema lock
0929 11:36:58.943878 (+ 31us) tablet.cc:660] Decoding operations
0929 11:36:59.203551 (+259673us) write_op.cc:620] Acquiring the partition lock for write op
0929 11:36:59.205341 (+ 1790us) write_op.cc:641] Partition lock acquired for write op
0929 11:36:59.210200 (+ 4859us) tablet.cc:683] Acquiring locks for 3 operations
0929 11:36:59.283423 (+ 73223us) tablet.cc:699] Row locks acquired
0929 11:36:59.283454 (+ 31us) write_op.cc:260] PREPARE: finished
0929 11:36:59.408051 (+124597us) write_op.cc:270] Start()
0929 11:36:59.445309 (+ 37258us) write_op.cc:276] Timestamp: P: 1790681819372962 usec, L: 0
0929 11:36:59.445364 (+ 55us) op_driver.cc:331] REPLICATION: starting
0929 11:36:59.539732 (+ 94368us) log.cc:842] Serialized 1325 byte log entry
0929 11:37:00.071359 (+531627us) op_driver.cc:444] REPLICATION: finished
0929 11:37:00.154157 (+ 82798us) write_op.cc:301] APPLY: starting
0929 11:37:00.154239 (+ 82us) tablet.cc:1365] starting BulkCheckPresence
0929 11:37:00.154358 (+ 119us) tablet.cc:1368] finished BulkCheckPresence
0929 11:37:00.154468 (+ 110us) tablet.cc:1370] starting ApplyRowOperation cycle
0929 11:37:00.186652 (+ 32184us) tablet.cc:1381] finished ApplyRowOperation cycle
0929 11:37:00.210219 (+ 23567us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0929 11:37:00.222249 (+ 12030us) write_op.cc:312] APPLY: finished
0929 11:37:00.238391 (+ 16142us) log.cc:842] Serialized 34 byte log entry
0929 11:37:00.238551 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:37:00.238640 (+ 89us) write_op.cc:454] Released schema lock
0929 11:37:00.238685 (+ 45us) write_op.cc:341] FINISH: Updating metrics
0929 11:37:00.238921 (+ 236us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:37:00.238974 (+ 53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1002772,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":78044,"apply.run_cpu_time_us":3002,"apply.run_wall_time_us":85096,"num_ops":3,"prepare.queue_time_us":661369,"prepare.run_cpu_time_us":25967,"prepare.run_wall_time_us":1044803,"raft.queue_time_us":63126,"raft.run_cpu_time_us":19800,"raft.run_wall_time_us":43660,"replication_time_us":622853,"thread_start_us":483119,"threads_started":4,"wal-append.queue_time_us":372308,"wal-append.run_cpu_time_us":34584,"wal-append.run_wall_time_us":1389086}]]}
I20260929 11:37:01.599788 17240 raft_consensus.cc:1226] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.663758 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 176) took 2725 ms. Trace:
I20260929 11:37:01.629953 18285 raft_consensus.cc:2726] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:01.666610 17390 raft_consensus.cc:1226] T 2f8d27c3483f4e0eadb60439434a5faa P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.667335 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 161) took 2427 ms. Trace:
I20260929 11:37:01.667819 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 303) took 1032 ms. Trace:
I20260929 11:37:01.504761 18342 consensus_queue.cc:1046] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260929 11:37:01.560961 17464 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:01.606870 18302 consensus_queue.cc:1046] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260929 11:37:01.700850 18302 raft_consensus.cc:3032] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:01.701215 18302 raft_consensus.cc:729] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:01.702004 18302 consensus_queue.cc:260] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.703168 18302 raft_consensus.cc:3037] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.560130 18131 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:01.707791 18263 consensus_meta.cc:287] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.515s user 0.008s sys 0.001s
I20260929 11:37:01.627944 17283 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:37:01.708683 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 80839us
W20260929 11:37:01.708958 18393 consensus_meta.cc:287] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.583s user 0.010s sys 0.000s
I20260929 11:37:01.709401 17239 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:01.709321 18393 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.711337 18393 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:01.711881 18393 raft_consensus.cc:2781] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:01.626042 17391 raft_consensus.cc:1226] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:01.679474 18315 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.712785 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 158) took 2788 ms. Trace:
I20260929 11:37:01.571009 18235 raft_consensus.cc:686] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:01.713120 17385 raft_consensus.cc:2379] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:01.713759 18235 consensus_queue.cc:237] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.713151 17391 rpcz_store.cc:276] 0929 11:36:58.924041 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.490886 (+2566845us) service_pool.cc:227] Handling call
0929 11:37:01.573741 (+ 82855us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.712505 (+138764us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.712724 (+ 219us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.715503 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.636824 17314 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:01.574278 18240 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.574219 17461 raft_consensus.cc:1226] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.717828 17385 raft_consensus.cc:1226] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 3. Ops: []
I20260929 11:37:01.718001 17461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 213) took 1561 ms. Trace:
I20260929 11:37:01.718241 18240 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:01.492249 17457 rpcz_store.cc:276] 0929 11:37:00.145512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.234350 (+1088838us) service_pool.cc:227] Handling call
0929 11:37:01.277274 (+ 42924us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.387436 (+110162us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.399671 (+ 12235us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.623926 17237 raft_consensus.cc:1261] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:01.718768 17385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 165) took 2237 ms. Trace:
I20260929 11:37:01.724502 17237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 255) took 1744 ms. Trace:
I20260929 11:37:01.725059 17237 rpcz_store.cc:276] 0929 11:36:59.980049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.583729 (+1603680us) service_pool.cc:227] Handling call
0929 11:37:01.584032 (+ 303us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.719023 (+134991us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.724438 (+ 5415us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.726183 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.727037 17237 raft_consensus.cc:2379] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:01.624866 18247 raft_consensus.cc:2781] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:01.502039 17387 rpcz_store.cc:276] 0929 11:36:58.897629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.405567 (+2507938us) service_pool.cc:227] Handling call
0929 11:37:01.406088 (+ 521us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.407145 (+ 1057us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.407444 (+ 299us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.627667 18145 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:01.741297 17315 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:01.741621 18145 raft_consensus.cc:686] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [term 4 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:01.719439 18393 raft_consensus.cc:686] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [term 4 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:01.628526 18174 raft_consensus.cc:3037] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:01.743005 17315 raft_consensus.cc:1261] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:01.743186 18393 consensus_queue.cc:237] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:01.743836 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 197) took 1938 ms. Trace:
I20260929 11:37:01.663909 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 258) took 1627 ms. Trace:
I20260929 11:37:01.744562 17240 rpcz_store.cc:276] 0929 11:37:00.036368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.599195 (+1562827us) service_pool.cc:227] Handling call
0929 11:37:01.599521 (+ 326us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.663570 (+ 64049us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.663842 (+ 272us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.745962 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.746747 17240 raft_consensus.cc:2362] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3. Re-sending same reply.
W20260929 11:37:01.609939 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 51303.9us
I20260929 11:37:01.748736 18315 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:01.664212 17313 rpcz_store.cc:276] 0929 11:36:58.938697 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.812408 (+1873711us) service_pool.cc:227] Handling call
0929 11:37:00.831070 (+ 18662us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.376305 (+545235us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.663531 (+287226us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54002913d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:01.663703 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1025019136}
I20260929 11:37:01.751977 17313 raft_consensus.cc:1226] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:01.758376 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 262) took 1952 ms. Trace:
I20260929 11:37:01.758831 17313 rpcz_store.cc:276] 0929 11:36:59.805642 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.751322 (+1945680us) service_pool.cc:227] Handling call
0929 11:37:01.751733 (+ 411us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.758047 (+ 6314us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.758310 (+ 263us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.601126 17282 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:01.762363 17283 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.667660 17390 rpcz_store.cc:276] 0929 11:36:59.240464 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.666185 (+2425721us) service_pool.cc:227] Handling call
0929 11:37:01.666456 (+ 271us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.667119 (+ 663us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.667285 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.668391 17463 rpcz_store.cc:276] 0929 11:37:00.635595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.587417 (+951822us) service_pool.cc:227] Handling call
0929 11:37:01.587717 (+ 300us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.662479 (+ 74762us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.667737 (+ 5258us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.669787 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:01.648620 17309 raft_consensus.cc:1261] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260929 11:37:01.649993 18229 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:01.674597 18371 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:01.676777 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 195) took 1926 ms. Trace:
I20260929 11:37:01.677583 18294 consensus_queue.cc:237] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.681982 17238 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:01.685068 18197 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.746765 17391 raft_consensus.cc:1226] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.596200 18192 consensus_queue.cc:260] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.687155 17459 raft_consensus.cc:1226] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.689186 17458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 195) took 1575 ms. Trace:
I20260929 11:37:01.649864 18027 consensus_queue.cc:1035] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260929 11:37:01.691311 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.660449 18016 raft_consensus.cc:2781] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:01.698964 18335 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:01.655652 17355 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
W20260929 11:37:01.730849 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 262411us
W20260929 11:37:01.696194 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 376702us
I20260929 11:37:01.744230 17315 rpcz_store.cc:276] 0929 11:36:59.805142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.742228 (+1937086us) service_pool.cc:227] Handling call
0929 11:37:01.742624 (+ 396us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.743559 (+ 935us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.743779 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.804711 17431 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:01.727994 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.665683 17208 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
W20260929 11:37:01.806322 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 140719us
I20260929 11:37:01.702888 18137 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:01.756522 18310 consensus_meta.cc:287] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.500s user 0.006s sys 0.004s
I20260929 11:37:01.747922 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.816054 17240 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:01.817281 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:37:01.767310 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 166270us
I20260929 11:37:01.778962 18285 raft_consensus.cc:2726] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:01.781323 17283 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.724313 17385 rpcz_store.cc:276] 0929 11:36:59.481653 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.717213 (+2235560us) service_pool.cc:227] Handling call
0929 11:37:01.717595 (+ 382us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.718466 (+ 871us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.718699 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.775230 17309 pending_rounds.cc:76] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a: Aborting all ops after (but not including) 1
I20260929 11:37:01.718513 17461 rpcz_store.cc:276] 0929 11:37:00.156761 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.493134 (+1336373us) service_pool.cc:227] Handling call
0929 11:37:01.569762 (+ 76628us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.717731 (+147969us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.717947 (+ 216us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.785018 17390 raft_consensus.cc:1226] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.785118 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 221) took 1070 ms. Trace:
I20260929 11:37:01.659803 18012 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:01.762269 17317 raft_consensus.cc:1226] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:01.708225 18263 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.787158 17313 raft_consensus.cc:1226] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:01.788162 17235 raft_consensus.cc:1226] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.780808 17234 raft_consensus.cc:2379] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:01.768165 18247 raft_consensus.cc:686] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:01.766671 18268 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:01.659832 17388 rpcz_store.cc:276] 0929 11:36:58.878874 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.316294 (+2437420us) service_pool.cc:227] Handling call
0929 11:37:01.319096 (+ 2802us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.415573 (+ 96477us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.444152 (+ 28579us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.775557 18259 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:01.652786 18373 consensus_queue.cc:237] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.886015 17464 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
W20260929 11:37:01.896414 18414 log.cc:924] Time spent T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.085s user 0.000s sys 0.001s
I20260929 11:37:01.896836 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 201) took 2958 ms. Trace:
I20260929 11:37:01.897593 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 157) took 2973 ms. Trace:
I20260929 11:37:01.897606 17464 raft_consensus.cc:3032] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:01.831434 18413 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.784431 18355 consensus_queue.cc:1046] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260929 11:37:01.801811 17312 raft_consensus.cc:1226] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:01.808123 17208 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.796171 17460 raft_consensus.cc:2379] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
W20260929 11:37:01.812932 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 157360us
I20260929 11:37:01.814702 17431 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:01.828147 18365 raft_consensus.cc:2726] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260929 11:37:01.866742 18408 log.cc:924] Time spent T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.287s user 0.000s sys 0.004s
I20260929 11:37:01.743048 18145 consensus_queue.cc:237] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.833971 17356 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:01.836865 18006 raft_consensus.cc:3032] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:01.849295 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:01.937335 17466 raft_consensus.cc:2379] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:01.853030 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 228) took 2050 ms. Trace:
I20260929 11:37:01.938117 17241 rpcz_store.cc:276] 0929 11:36:59.802820 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.243030 (+1440210us) service_pool.cc:227] Handling call
0929 11:37:01.587170 (+344140us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.587705 (+ 535us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.852508 (+264803us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400022e50. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:01.852872 (+ 364us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":790785408}
I20260929 11:37:01.854966 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 295) took 1787 ms. Trace:
I20260929 11:37:01.939395 17462 rpcz_store.cc:276] 0929 11:37:00.067622 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:00.783751 (+716129us) service_pool.cc:227] Handling call
0929 11:37:01.041429 (+257678us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b580004c898. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:01.087790 (+ 46361us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.492104 (+404314us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.854367 (+362263us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400531954. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:01.854821 (+ 454us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":807454848}
I20260929 11:37:01.857162 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 257) took 2698 ms. Trace:
I20260929 11:37:01.859754 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 196) took 2970 ms. Trace:
I20260929 11:37:01.825671 17283 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:37:01.945736 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 111892us
I20260929 11:37:01.789955 18403 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.827677 18182 raft_consensus.cc:2781] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:01.868250 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 263) took 2034 ms. Trace:
I20260929 11:37:01.948791 17313 rpcz_store.cc:276] 0929 11:36:59.834287 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.761838 (+1927551us) service_pool.cc:227] Handling call
0929 11:37:01.787010 (+ 25172us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.832991 (+ 45981us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.868176 (+ 35185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.823031 17463 rpcz_store.cc:276] 0929 11:37:00.715053 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.765376 (+1050323us) service_pool.cc:227] Handling call
0929 11:37:01.784663 (+ 19287us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.784823 (+ 160us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.784846 (+ 23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.784883 (+ 37us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:01.784909 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.784953 (+ 44us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.785062 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.802783 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 220) took 1903 ms. Trace:
I20260929 11:37:01.822207 17309 pending_rounds.cc:97] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260929 11:37:01.827535 17240 raft_consensus.cc:2379] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:01.957297 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.786550 18412 consensus_queue.cc:1035] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260929 11:37:01.811681 18274 raft_consensus.cc:2726] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:01.831970 17459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 304) took 1194 ms. Trace:
I20260929 11:37:01.878046 18263 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:37:01.718782 17957 consensus_queue.cc:1159] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "013a37bea2eb40c0ad4ce8f296176573" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260929 11:37:01.882344 18411 log.cc:924] Time spent T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
W20260929 11:37:01.885936 18418 log.cc:924] Time spent T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
W20260929 11:37:01.886902 18406 log.cc:924] Time spent T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.295s user 0.001s sys 0.000s
I20260929 11:37:01.887183 17236 raft_consensus.cc:2379] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:01.784089 17318 rpcz_store.cc:276] 0929 11:36:59.750433 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.592872 (+1842439us) service_pool.cc:227] Handling call
0929 11:37:01.597357 (+ 4485us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.631109 (+ 33752us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.635993 (+ 4884us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.650817 (+ 14824us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:01.658069 (+ 7252us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.663794 (+ 5725us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.676694 (+ 12900us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:01.887836 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 260) took 2362 ms. Trace:
I20260929 11:37:01.823026 18310 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:01.898311 17464 raft_consensus.cc:729] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:01.898203 17389 rpcz_store.cc:276] 0929 11:36:58.923739 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.414007 (+2490268us) service_pool.cc:227] Handling call
0929 11:37:01.439995 (+ 25988us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.444505 (+ 4510us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.444537 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:01.465849 (+ 21312us) log.cc:842] Serialized 26 byte log entry
0929 11:37:01.660896 (+195047us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:01.660937 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.660994 (+ 57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:01.897399 (+236405us) raft_consensus.cc:1671] finished
0929 11:37:01.897420 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.897541 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4079,"raft.queue_time_us":6045,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":13653,"thread_start_us":156593,"threads_started":1,"wal-append.queue_time_us":298050}
I20260929 11:37:01.800027 18197 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:01.825855 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 219) took 1922 ms. Trace:
W20260929 11:37:01.912640 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 104634us
W20260929 11:37:01.915462 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 100856us
I20260929 11:37:01.810638 18016 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:01.829439 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 168) took 1904 ms. Trace:
I20260929 11:37:01.919728 18131 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.920588 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:01.917045 18275 raft_consensus.cc:2726] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:01.921432 18247 consensus_queue.cc:237] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.926229 18217 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:01.929836 17312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 194) took 2452 ms. Trace:
I20260929 11:37:01.930881 18307 raft_consensus.cc:3032] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:37:01.931231 18192 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:01.831743 18369 consensus_queue.cc:1035] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260929 11:37:01.826117 17237 raft_consensus.cc:2454] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:37:01.888792 18259 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:37:01.946012 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 120421us
I20260929 11:37:01.946259 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 301) took 1631 ms. Trace:
I20260929 11:37:01.867738 18285 consensus_queue.cc:1046] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260929 11:37:01.933179 17386 raft_consensus.cc:2379] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 4: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:01.795687 17458 rpcz_store.cc:276] 0929 11:37:00.114179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.182370 (+1068191us) service_pool.cc:227] Handling call
0929 11:37:01.182709 (+ 339us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.404618 (+221909us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.688790 (+284172us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400056c54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:01.689101 (+ 311us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":267929472}
I20260929 11:37:01.947455 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 196) took 2177 ms. Trace:
W20260929 11:37:01.942550 18416 log.cc:924] Time spent T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260929 11:37:01.917474 18371 raft_consensus.cc:2726] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:01.953941 17356 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:37:01.975241 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 144466us
I20260929 11:37:01.976871 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:01.936744 18006 raft_consensus.cc:729] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:01.890954 18268 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:01.991776 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:01.976773 18182 raft_consensus.cc:686] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:02.002120 17357 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:01.989473 18341 consensus_queue.cc:1046] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260929 11:37:01.984222 18355 consensus_queue.cc:1046] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
W20260929 11:37:02.118799 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 116757us
I20260929 11:37:01.956171 18365 raft_consensus.cc:2781] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:02.003363 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:02.125841 17313 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:01.978592 17309 raft_consensus.cc:2866] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:37:01.978360 17461 raft_consensus.cc:1261] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260929 11:37:01.953011 18361 raft_consensus.cc:2726] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:02.034698 17242 raft_consensus.cc:1226] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 3. Ops: []
I20260929 11:37:02.139575 17461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 202) took 1236 ms. Trace:
I20260929 11:37:02.139997 17461 rpcz_store.cc:276] 0929 11:37:00.903227 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.867600 (+964373us) service_pool.cc:227] Handling call
0929 11:37:01.913451 (+ 45851us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.139327 (+225876us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.139523 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.053288 17243 raft_consensus.cc:1226] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:02.141103 18131 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:02.142104 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:02.142221 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 232) took 2329 ms. Trace:
I20260929 11:37:02.052901 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 233) took 1257 ms. Trace:
I20260929 11:37:02.142760 17237 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.143381 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 233) took 2330 ms. Trace:
I20260929 11:37:02.043617 17391 rpcz_store.cc:276] 0929 11:36:59.898019 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.746196 (+1848177us) service_pool.cc:227] Handling call
0929 11:37:01.746555 (+ 359us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.795227 (+ 48672us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.820339 (+ 25112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.146507 18285 consensus_queue.cc:1225] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer 26cd298fcaa34c9f93d8793e64f0e863 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260929 11:37:02.146710 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:02.127331 18217 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.043906 17464 consensus_queue.cc:260] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.071188 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 175) took 1701 ms. Trace:
W20260929 11:37:02.109335 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 155491us
I20260929 11:37:02.148564 17464 raft_consensus.cc:3037] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:02.148686 18027 raft_consensus.cc:3032] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:02.149143 18027 raft_consensus.cc:729] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:02.148415 17389 rpcz_store.cc:276] 0929 11:37:00.369931 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.045570 (+1675639us) service_pool.cc:227] Handling call
0929 11:37:02.070545 (+ 24975us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.070767 (+ 222us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.070813 (+ 46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.070867 (+ 54us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:02.070908 (+ 41us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.070974 (+ 66us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.071119 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.150481 17389 raft_consensus.cc:1226] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:02.150142 18027 consensus_queue.cc:260] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.151073 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 177) took 1462 ms. Trace:
I20260929 11:37:02.151350 18027 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.045668 17431 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:02.152443 18217 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:02.152608 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 107015us
I20260929 11:37:02.121271 18307 raft_consensus.cc:729] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:02.152447 18275 raft_consensus.cc:2781] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:02.036779 17388 raft_consensus.cc:1226] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:01.945319 17384 rpcz_store.cc:276] 0929 11:36:58.889652 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.379812 (+2490160us) service_pool.cc:227] Handling call
0929 11:37:01.380172 (+ 360us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.464132 (+ 83960us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.859260 (+395128us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b54006b38a0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9824730 00007f79b9897b42 00007f79b9893f26 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772
0929 11:37:01.859629 (+ 369us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11467136}
I20260929 11:37:02.153756 18307 consensus_queue.cc:260] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:01.953420 18174 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:02.112787 17429 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:01.952414 18315 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.048028 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 209) took 1932 ms. Trace:
W20260929 11:37:02.037942 18417 log.cc:924] Time spent T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260929 11:37:02.121737 17283 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:02.122035 17390 rpcz_store.cc:276] 0929 11:36:59.925247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.765241 (+1839994us) service_pool.cc:227] Handling call
0929 11:37:01.784863 (+ 19622us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.822762 (+ 37899us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.829373 (+ 6611us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.116348 17314 rpcz_store.cc:276] 0929 11:36:59.769720 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.716715 (+1946995us) service_pool.cc:227] Handling call
0929 11:37:01.716985 (+ 270us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.717156 (+ 171us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:01.822227 (+105071us) log.cc:842] Serialized 14 byte log entry
0929 11:37:01.937508 (+115281us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.937772 (+ 264us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:01.937812 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.937871 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.947393 (+ 9522us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1574,"prepare.queue_time_us":261856,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":340,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5768,"thread_start_us":219361,"threads_started":2,"wal-append.queue_time_us":178339}
I20260929 11:37:02.115909 17312 rpcz_store.cc:276] 0929 11:36:59.477833 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.430628 (+1952795us) service_pool.cc:227] Handling call
0929 11:37:01.446180 (+ 15552us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.915681 (+469501us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.929560 (+ 13879us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540024ca54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:01.929772 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":808274688}
I20260929 11:37:02.117659 17465 rpcz_store.cc:276] 0929 11:37:00.314514 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.582444 (+1267930us) service_pool.cc:227] Handling call
0929 11:37:01.582729 (+ 285us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.583031 (+ 302us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.583056 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:01.583436 (+ 380us) log.cc:842] Serialized 26 byte log entry
0929 11:37:01.774682 (+191246us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:01.945720 (+171038us) log.cc:842] Serialized 14 byte log entry
0929 11:37:01.945964 (+ 244us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.946037 (+ 73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:01.946080 (+ 43us) raft_consensus.cc:1671] finished
0929 11:37:01.946090 (+ 10us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.946211 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1239,"raft.queue_time_us":11091,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":32712,"thread_start_us":336293,"threads_started":2,"wal-append.queue_time_us":207728}
I20260929 11:37:02.168637 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:01.981233 17459 rpcz_store.cc:276] 0929 11:37:00.635918 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.628308 (+992390us) service_pool.cc:227] Handling call
0929 11:37:01.662477 (+ 34169us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.801560 (+139083us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.830372 (+ 28812us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.059026 18310 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:01.908041 17383 rpcz_store.cc:276] 0929 11:36:58.938298 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.578177 (+2639879us) service_pool.cc:227] Handling call
0929 11:37:01.578534 (+ 357us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.578940 (+ 406us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.578976 (+ 36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:01.579455 (+ 479us) log.cc:842] Serialized 26 byte log entry
0929 11:37:01.666418 (+ 86963us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:01.828167 (+161749us) log.cc:842] Serialized 14 byte log entry
0929 11:37:01.871311 (+ 43144us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.890310 (+ 18999us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:01.896565 (+ 6255us) raft_consensus.cc:1671] finished
0929 11:37:01.896588 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.896755 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":200419,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":35097,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":7914,"thread_start_us":209431,"threads_started":2,"wal-append.queue_time_us":204746}
I20260929 11:37:02.129187 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.037643 17310 rpcz_store.cc:276] 0929 11:36:59.525088 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.576050 (+2050962us) service_pool.cc:227] Handling call
0929 11:37:01.576562 (+ 512us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.577015 (+ 453us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.577062 (+ 47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:01.577571 (+ 509us) log.cc:842] Serialized 26 byte log entry
0929 11:37:01.778944 (+201373us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:01.779079 (+ 135us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.779388 (+ 309us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:01.887556 (+108168us) raft_consensus.cc:1671] finished
0929 11:37:01.887595 (+ 39us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.887773 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1007,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":200854,"threads_started":1,"wal-append.queue_time_us":249996}
I20260929 11:37:02.110770 18016 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:02.129241 18182 consensus_queue.cc:237] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.130250 18294 consensus_queue.cc:1046] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260929 11:37:02.129926 18006 consensus_queue.cc:260] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.131266 18268 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:01.943218 17311 rpcz_store.cc:276] 0929 11:36:59.158980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.128887 (+1969907us) service_pool.cc:227] Handling call
0929 11:37:01.495401 (+366514us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.586088 (+ 90687us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.856675 (+270587us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400341550. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:01.857016 (+ 341us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":836204928}
I20260929 11:37:02.217250 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:02.218588 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:02.076519 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 206) took 1965 ms. Trace:
I20260929 11:37:02.143035 17236 rpcz_store.cc:276] 0929 11:37:00.795293 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.102188 (+306895us) service_pool.cc:227] Handling call
0929 11:37:02.052668 (+950480us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540064e6d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:02.052837 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1513153280}
I20260929 11:37:02.138343 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 261) took 2609 ms. Trace:
I20260929 11:37:02.147354 17391 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.115304 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.224658 17463 raft_consensus.cc:2379] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:02.155004 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:02.225755 17241 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:02.143762 17242 rpcz_store.cc:276] 0929 11:36:59.813044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.406682 (+1593638us) service_pool.cc:227] Handling call
0929 11:37:02.034519 (+627837us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.138996 (+104477us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.143183 (+ 4187us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400045950. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:02.143329 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1443075456}
I20260929 11:37:02.047385 17235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 257) took 2050 ms. Trace:
I20260929 11:37:02.151381 17389 rpcz_store.cc:276] 0929 11:37:00.688935 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.150032 (+1461097us) service_pool.cc:227] Handling call
0929 11:37:02.150322 (+ 290us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.150850 (+ 528us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.151025 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.047022 18403 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:02.048626 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:02.115252 18342 raft_consensus.cc:2781] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:02.116007 17240 raft_consensus.cc:2379] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:02.183187 18080 consensus_queue.cc:1046] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260929 11:37:02.047683 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 177) took 3108 ms. Trace:
I20260929 11:37:02.048156 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:02.170785 17384 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:02.171640 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.245895 17390 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:02.246444 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:02.172016 18174 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:37:02.172159 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 59476.3us
W20260929 11:37:02.172492 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 50809.3us
I20260929 11:37:02.249109 17208 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:02.249670 17283 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:02.249923 18240 raft_consensus.cc:2781] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:02.250304 18240 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:02.250679 18240 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.172612 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 222) took 2214 ms. Trace:
I20260929 11:37:02.250764 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:02.251129 17388 rpcz_store.cc:276] 0929 11:36:59.958533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.907883 (+1949350us) service_pool.cc:227] Handling call
0929 11:37:01.990955 (+ 83072us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.172354 (+181399us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.172557 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:02.251971 18432 log.cc:924] Time spent T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.121s user 0.001s sys 0.000s
I20260929 11:37:02.234773 18412 consensus_queue.cc:1046] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260929 11:37:02.252666 17388 raft_consensus.cc:1261] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:02.252861 18310 raft_consensus.cc:3032] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:02.253017 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 234) took 1438 ms. Trace:
I20260929 11:37:02.253309 18310 raft_consensus.cc:729] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:02.253470 17384 rpcz_store.cc:276] 0929 11:37:00.814928 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.154197 (+1339269us) service_pool.cc:227] Handling call
0929 11:37:02.154507 (+ 310us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.252748 (+ 98241us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.252961 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.254383 18369 raft_consensus.cc:2726] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:02.173026 17957 raft_consensus.cc:2741] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260929 11:37:02.248009 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:02.254943 18294 raft_consensus.cc:3032] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:02.255203 17238 raft_consensus.cc:2379] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:02.255357 18294 raft_consensus.cc:729] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:02.173099 18285 raft_consensus.cc:2741] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260929 11:37:02.256137 18294 consensus_queue.cc:260] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.257392 18294 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.250862 17283 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:02.160777 18365 raft_consensus.cc:686] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:02.258704 17283 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:02.258862 18365 consensus_queue.cc:237] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.259367 18174 consensus_queue.cc:1035] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:02.259807 18285 raft_consensus.cc:2781] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:02.260186 18285 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:02.260581 18285 raft_consensus.cc:3037] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:02.173363 17461 raft_consensus.cc:1261] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260929 11:37:02.266088 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 83868.1us
I20260929 11:37:02.175242 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:01.952483 17387 rpcz_store.cc:276] 0929 11:36:59.899398 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.753328 (+1853930us) service_pool.cc:227] Handling call
0929 11:37:01.753754 (+ 426us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.780372 (+ 26618us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:01.783228 (+ 2856us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:01.786653 (+ 3425us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:01.790461 (+ 3808us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:01.794804 (+ 4343us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:01.802699 (+ 7895us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:02.201962 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 52980.9us
I20260929 11:37:02.271016 17356 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:02.125346 18197 consensus_queue.cc:1046] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260929 11:37:02.051671 18229 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.166831 18275 raft_consensus.cc:686] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:02.214037 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:02.278968 17314 raft_consensus.cc:2379] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:02.180546 18131 raft_consensus.cc:3032] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:02.123886 18259 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.196698 18348 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:02.210229 18307 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:02.169677 17318 rpcz_store.cc:276] 0929 11:37:00.115502 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.041445 (+1925943us) service_pool.cc:227] Handling call
0929 11:37:02.047456 (+ 6011us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.047646 (+ 190us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.047673 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.047729 (+ 56us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:02.047769 (+ 40us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.047839 (+ 70us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.047967 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.221355 17316 rpcz_store.cc:276] 0929 11:37:00.111142 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.910072 (+1798930us) service_pool.cc:227] Handling call
0929 11:37:01.922741 (+ 12669us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.922988 (+ 247us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:01.985166 (+ 62178us) log.cc:842] Serialized 14 byte log entry
0929 11:37:02.076071 (+ 90905us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.076130 (+ 59us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:02.076178 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.076260 (+ 82us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.076453 (+ 193us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":116316,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":117,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":874752,"thread_start_us":106051,"threads_started":2,"wal-append.queue_time_us":134051}
I20260929 11:37:02.203367 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 261) took 2032 ms. Trace:
I20260929 11:37:02.174947 18217 consensus_queue.cc:1046] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260929 11:37:02.174728 18315 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:02.053489 18302 raft_consensus.cc:3032] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:02.244151 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:02.307047 17242 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:02.254210 18310 consensus_queue.cc:260] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.256597 17238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 264) took 1626 ms. Trace:
I20260929 11:37:02.288837 17234 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:37:02.166520 18161 consensus_queue.cc:1046] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260929 11:37:02.056847 18137 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:02.142792 17243 rpcz_store.cc:276] 0929 11:36:59.812744 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.286438 (+1473694us) service_pool.cc:227] Handling call
0929 11:37:02.053066 (+766628us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.141156 (+ 88090us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.141969 (+ 813us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b540064e6d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:02.142149 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1762234752}
W20260929 11:37:02.263548 17283 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 3.256s (SENT) [suppressed 47 similar messages]
I20260929 11:37:02.241621 17386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 203) took 1865 ms. Trace:
I20260929 11:37:02.243561 18006 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:02.309315 17392 raft_consensus.cc:1226] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:02.306599 18302 raft_consensus.cc:729] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:02.245817 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:02.245582 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:02.248255 18342 raft_consensus.cc:686] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:02.266827 18346 raft_consensus.cc:3032] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:02.233335 17235 rpcz_store.cc:276] 0929 11:36:59.993408 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.586679 (+1593271us) service_pool.cc:227] Handling call
0929 11:37:01.586991 (+ 312us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:01.871323 (+284332us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.032855 (+161532us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540032d054. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:02.043822 (+ 10967us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":445281536}
I20260929 11:37:02.275305 17457 raft_consensus.cc:1226] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:02.278275 18197 raft_consensus.cc:3032] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:02.223593 17309 rpcz_store.cc:276] 0929 11:36:59.529069 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.591843 (+2062774us) service_pool.cc:227] Handling call
0929 11:37:01.592166 (+ 323us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.138066 (+545900us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.138289 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.274518 18145 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:02.379781 18145 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:02.380170 17243 raft_consensus.cc:1226] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:02.303133 17314 raft_consensus.cc:1226] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:02.307546 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:02.380877 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 239) took 1546 ms. Trace:
I20260929 11:37:02.380985 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 215) took 2128 ms. Trace:
I20260929 11:37:02.362332 17318 raft_consensus.cc:1261] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:02.381479 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:02.380187 18145 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.382172 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 217) took 1665 ms. Trace:
I20260929 11:37:02.382700 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.382645 17318 rpcz_store.cc:276] 0929 11:37:00.716924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.304895 (+1587971us) service_pool.cc:227] Handling call
0929 11:37:02.324976 (+ 20081us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.381926 (+ 56950us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.382120 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.288010 18355 raft_consensus.cc:2726] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:02.283457 18131 raft_consensus.cc:729] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:02.254233 17388 raft_consensus.cc:1261] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:02.245357 17317 rpcz_store.cc:276] 0929 11:36:58.938971 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.103613 (+2164642us) service_pool.cc:227] Handling call
0929 11:37:01.103964 (+ 351us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.867860 (+763896us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.036408 (+168548us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400290754. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:02.043496 (+ 7088us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1438234496}
I20260929 11:37:02.317893 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.397079 17466 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.320482 17313 raft_consensus.cc:2454] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:02.323948 18439 consensus_queue.cc:1046] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:02.400956 17312 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:02.324345 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:02.312660 17238 rpcz_store.cc:276] 0929 11:37:00.630177 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.255792 (+1625615us) service_pool.cc:227] Handling call
0929 11:37:02.256074 (+ 282us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.256240 (+ 166us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.256269 (+ 29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.256342 (+ 73us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:02.256375 (+ 33us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.256439 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.256547 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:02.324687 18335 consensus_meta.cc:287] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.512s user 0.010s sys 0.000s
I20260929 11:37:02.289068 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:02.325512 17463 raft_consensus.cc:1226] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:02.275547 18080 consensus_queue.cc:1046] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260929 11:37:02.339089 17242 raft_consensus.cc:1226] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:02.407089 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 238) took 1573 ms. Trace:
I20260929 11:37:02.407426 17242 rpcz_store.cc:276] 0929 11:37:00.833583 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.307976 (+1474393us) service_pool.cc:227] Handling call
0929 11:37:02.335111 (+ 27135us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.406857 (+ 71746us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.407035 (+ 178us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.294643 18371 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:02.284659 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 239) took 1474 ms. Trace:
I20260929 11:37:02.348645 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:02.312805 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:02.338022 18274 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:02.383911 18016 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:02.355597 17458 raft_consensus.cc:1226] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:02.356153 17234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 222) took 1998 ms. Trace:
I20260929 11:37:02.326113 18263 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.433018 17236 raft_consensus.cc:2379] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:02.433291 18263 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.435048 18274 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.435722 18263 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:02.302434 18369 consensus_queue.cc:1035] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260929 11:37:02.436647 17238 raft_consensus.cc:1226] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:02.437049 18274 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:02.338112 17386 rpcz_store.cc:276] 0929 11:37:00.373768 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.147492 (+1773724us) service_pool.cc:227] Handling call
0929 11:37:02.147885 (+ 393us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.184956 (+ 37071us) raft_consensus.cc:1520] Early marking committed up to index 1
0929 11:37:02.207419 (+ 22463us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.210638 (+ 3219us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:02.214673 (+ 4035us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.224016 (+ 9343us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.238660 (+ 14644us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31127,"raft.queue_time_us":50581,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8360}
I20260929 11:37:02.438465 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:02.438653 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.439821 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.426633 17311 raft_consensus.cc:1226] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:02.440984 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.441898 18016 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:02.363166 18275 consensus_queue.cc:237] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.442788 17317 raft_consensus.cc:1226] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:02.443461 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 275) took 1272 ms. Trace:
I20260929 11:37:02.443792 17317 rpcz_store.cc:276] 0929 11:37:01.170709 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.406195 (+1235486us) service_pool.cc:227] Handling call
0929 11:37:02.442601 (+ 36406us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.443216 (+ 615us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.443406 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.444834 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:02.446069 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.410405 17461 raft_consensus.cc:1226] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:02.448220 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.448789 17461 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:02.293936 18438 consensus_queue.cc:1035] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260929 11:37:02.372066 17316 raft_consensus.cc:1226] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:02.379257 17309 raft_consensus.cc:1226] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:02.351647 18310 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.338901 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.383925 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.463321 17464 raft_consensus.cc:1261] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:02.381409 17314 rpcz_store.cc:276] 0929 11:37:00.252977 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.279596 (+2026619us) service_pool.cc:227] Handling call
0929 11:37:02.302962 (+ 23366us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.380773 (+ 77811us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.380938 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.386343 17431 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
W20260929 11:37:02.359449 18434 log.cc:924] Time spent T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.159s user 0.001s sys 0.000s
I20260929 11:37:02.442119 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.328603 18412 consensus_queue.cc:1046] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260929 11:37:02.357651 17384 raft_consensus.cc:1261] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:02.400274 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 273) took 1230 ms. Trace:
I20260929 11:37:02.571889 17313 rpcz_store.cc:276] 0929 11:37:01.170148 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.399635 (+1229487us) service_pool.cc:227] Handling call
0929 11:37:02.399957 (+ 322us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.400081 (+ 124us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.400096 (+ 15us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.400122 (+ 26us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:02.400139 (+ 17us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.400169 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.400234 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.362655 18346 raft_consensus.cc:729] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
W20260929 11:37:02.408761 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 101702us
I20260929 11:37:02.384802 18197 raft_consensus.cc:729] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:02.583420 18197 consensus_queue.cc:260] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.294324 17239 rpcz_store.cc:276] 0929 11:37:00.152924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.711532 (+1558608us) service_pool.cc:227] Handling call
0929 11:37:01.711956 (+ 424us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:01.712213 (+ 257us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:01.996908 (+284695us) log.cc:842] Serialized 14 byte log entry
0929 11:37:02.131810 (+134902us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.137063 (+ 5253us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:02.160809 (+ 23746us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.174910 (+ 14101us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.185289 (+ 10379us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33,"prepare.queue_time_us":314123,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":14022,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"thread_start_us":257948,"threads_started":2,"wal-append.queue_time_us":173127}
I20260929 11:37:02.584261 18274 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.410360 17241 rpcz_store.cc:276] 0929 11:37:00.810134 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.263260 (+1453126us) service_pool.cc:227] Handling call
0929 11:37:02.284146 (+ 20886us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.284361 (+ 215us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.284386 (+ 25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.284435 (+ 49us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:02.284462 (+ 27us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.284517 (+ 55us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.284609 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.586593 17239 raft_consensus.cc:1226] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:02.586408 18274 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.587301 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 272) took 1175 ms. Trace:
I20260929 11:37:02.587642 17241 raft_consensus.cc:1261] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:02.585057 18197 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.590468 17241 raft_consensus.cc:1226] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:02.591953 17241 raft_consensus.cc:1226] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:02.413199 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.413271 17355 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:02.592621 18274 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:02.593277 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 180108us
I20260929 11:37:02.445004 17317 raft_consensus.cc:3032] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:02.446921 17310 raft_consensus.cc:1261] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:02.311034 18403 consensus_queue.cc:1046] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260929 11:37:02.378793 18413 raft_consensus.cc:2726] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:02.447050 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:37:02.454161 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 190638us
W20260929 11:37:02.454252 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 44650us
I20260929 11:37:02.410928 18302 consensus_queue.cc:260] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:02.413513 18348 raft_consensus.cc:686] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
W20260929 11:37:02.564368 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 178098us
I20260929 11:37:02.574493 18229 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:02.567869 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 215) took 1426 ms. Trace:
I20260929 11:37:02.414999 18373 consensus_queue.cc:1046] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260929 11:37:02.432705 17234 rpcz_store.cc:276] 0929 11:37:00.357437 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.251939 (+1894502us) service_pool.cc:227] Handling call
0929 11:37:02.252291 (+ 352us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:02.334034 (+ 81743us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.356094 (+ 22060us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.574117 17313 raft_consensus.cc:1261] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260929 11:37:02.674193 17313 pending_rounds.cc:76] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a: Aborting all ops after (but not including) 2
I20260929 11:37:02.447137 18131 consensus_queue.cc:260] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:02.674526 17313 pending_rounds.cc:97] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260929 11:37:02.582163 18452 raft_consensus.cc:3032] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:37:02.592912 17465 raft_consensus.cc:2379] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:02.381254 17243 rpcz_store.cc:276] 0929 11:37:00.834021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.351853 (+1517832us) service_pool.cc:227] Handling call
0929 11:37:02.379994 (+ 28141us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.380636 (+ 642us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.380825 (+ 189us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:02.593645 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 140926us
I20260929 11:37:02.417802 17466 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:02.450484 18341 consensus_queue.cc:1035] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260929 11:37:02.419116 18371 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.607527 17312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 208) took 2437 ms. Trace:
I20260929 11:37:02.683126 17312 rpcz_store.cc:276] 0929 11:37:00.169779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.277235 (+2107456us) service_pool.cc:227] Handling call
0929 11:37:02.400767 (+123532us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.404024 (+ 3257us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.607359 (+203335us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400648f50. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:02.607476 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":257723776}
I20260929 11:37:02.459378 18080 consensus_queue.cc:1225] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer bb8e3505668b40219823840c0d8bc3af log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260929 11:37:02.614116 17355 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:02.569300 17463 raft_consensus.cc:1261] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:02.483700 17388 raft_consensus.cc:2454] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:02.576292 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 269) took 1975 ms. Trace:
I20260929 11:37:02.573932 18447 raft_consensus.cc:2726] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:37:02.587643 17239 rpcz_store.cc:276] 0929 11:37:01.412006 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.585961 (+1173955us) service_pool.cc:227] Handling call
0929 11:37:02.586366 (+ 405us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:02.587028 (+ 662us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.587243 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.599920 17317 raft_consensus.cc:729] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:02.606570 18299 raft_consensus.cc:3032] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:02.714916 18027 consensus_queue.cc:1046] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:02.703111 18229 raft_consensus.cc:2726] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:37:02.715641 18299 raft_consensus.cc:729] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
W20260929 11:37:02.715843 18192 consensus_meta.cc:287] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.588s user 0.007s sys 0.002s
I20260929 11:37:02.710466 18444 consensus_queue.cc:1046] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260929 11:37:02.716602 18299 consensus_queue.cc:260] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:02.717175 18444 raft_consensus.cc:3032] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:02.717526 18444 raft_consensus.cc:729] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:02.717639 18299 raft_consensus.cc:3037] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:02.718295 18444 consensus_queue.cc:260] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:02.712617 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 269) took 1519 ms. Trace:
I20260929 11:37:02.666165 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.606570 18355 raft_consensus.cc:2781] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:02.672816 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 270) took 1913 ms. Trace:
I20260929 11:37:02.660116 17241 raft_consensus.cc:1226] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:02.725358 17356 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:02.726058 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 247) took 1005 ms. Trace:
I20260929 11:37:02.674796 17313 raft_consensus.cc:2866] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:37:02.701016 18131 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:02.676123 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 60663.6us
I20260929 11:37:02.608987 18315 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:02.688119 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:02.470155 18342 consensus_queue.cc:237] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:02.695240 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 81244us
I20260929 11:37:02.662631 18438 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.606045 18161 consensus_queue.cc:1035] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260929 11:37:02.744697 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.662482 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 277) took 1174 ms. Trace:
I20260929 11:37:02.662801 17389 rpcz_store.cc:276] 0929 11:37:01.141401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.233589 (+1092188us) service_pool.cc:227] Handling call
0929 11:37:02.246655 (+ 13066us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:02.262782 (+ 16127us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.262812 (+ 30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:02.271086 (+ 8274us) log.cc:842] Serialized 26 byte log entry
0929 11:37:02.351270 (+ 80184us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:02.364637 (+ 13367us) log.cc:842] Serialized 14 byte log entry
0929 11:37:02.392000 (+ 27363us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.392114 (+ 114us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:02.567658 (+175544us) raft_consensus.cc:1671] finished
0929 11:37:02.567679 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.567813 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":228532,"prepare.queue_time_us":13026,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":52866,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":14259,"thread_start_us":41883,"threads_started":1,"wal-append.queue_time_us":100925}
I20260929 11:37:02.609807 18182 consensus_queue.cc:1046] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260929 11:37:02.714743 17317 consensus_queue.cc:260] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:02.698609 17316 rpcz_store.cc:276] 0929 11:37:00.600515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.304426 (+1703911us) service_pool.cc:227] Handling call
0929 11:37:02.358885 (+ 54459us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.462306 (+103421us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.567946 (+105640us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.675838 18302 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:02.660848 18217 consensus_queue.cc:1035] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260929 11:37:02.736258 18229 raft_consensus.cc:2781] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election won for term 4
W20260929 11:37:02.674624 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 58213.2us
W20260929 11:37:02.727190 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 52668.7us
I20260929 11:37:02.726418 17241 rpcz_store.cc:276] 0929 11:37:01.721062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.598785 (+877723us) service_pool.cc:227] Handling call
0929 11:37:02.659935 (+ 61150us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.725819 (+ 65884us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.726009 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:02.760742 17431 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
W20260929 11:37:02.685421 17237 consensus_meta.cc:287] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.542s user 0.019s sys 0.017s
I20260929 11:37:02.719905 18080 consensus_queue.cc:1046] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260929 11:37:02.731334 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:02.721076 18371 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:02.719473 18444 raft_consensus.cc:3037] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:02.619107 18145 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:02.772795 18463 raft_consensus.cc:3032] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:02.773860 18315 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.774360 18145 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:02.713079 18450 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:02.777240 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 243) took 1593 ms. Trace:
I20260929 11:37:02.777647 17242 rpcz_store.cc:276] 0929 11:37:01.183364 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.408197 (+1224833us) service_pool.cc:227] Handling call
0929 11:37:02.450687 (+ 42490us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:02.457784 (+ 7097us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.457832 (+ 48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:02.469098 (+ 11266us) log.cc:842] Serialized 26 byte log entry
0929 11:37:02.600467 (+131369us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:02.600502 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.600570 (+ 68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:02.777026 (+176456us) raft_consensus.cc:1671] finished
0929 11:37:02.777046 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.777184 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1615,"raft.queue_time_us":111823,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8713,"thread_start_us":130986,"threads_started":1,"wal-append.queue_time_us":268903}
I20260929 11:37:02.702819 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 272) took 1939 ms. Trace:
I20260929 11:37:02.719228 17236 rpcz_store.cc:276] 0929 11:37:01.190128 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.434176 (+1244048us) service_pool.cc:227] Handling call
0929 11:37:02.434516 (+ 340us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.660987 (+226471us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.665783 (+ 4796us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.673896 (+ 8113us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:02.682279 (+ 8383us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.693344 (+ 11065us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.709196 (+ 15852us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3342,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"thread_start_us":178295,"threads_started":1}
I20260929 11:37:02.780470 17318 rpcz_store.cc:276] 0929 11:37:00.760350 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.383572 (+1623222us) service_pool.cc:227] Handling call
0929 11:37:02.383869 (+ 297us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.384099 (+ 230us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:02.398771 (+ 14672us) log.cc:842] Serialized 14 byte log entry
0929 11:37:02.617107 (+218336us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:02.663573 (+ 46466us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:02.665833 (+ 2260us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.680118 (+ 14285us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:02.700119 (+ 20001us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":101381,"prepare.queue_time_us":9053,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":150145,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":47195,"thread_start_us":54264,"threads_started":1,"wal-append.queue_time_us":345123}
I20260929 11:37:02.782558 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:02.714943 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.712390 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.726380 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:02.784109 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:02.687144 18413 consensus_queue.cc:1035] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260929 11:37:02.749366 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:02.751560 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:37:02.744735 18373 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.676509 18452 raft_consensus.cc:729] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:02.754374 17312 raft_consensus.cc:1261] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260929 11:37:02.736794 18355 raft_consensus.cc:686] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:02.743572 17391 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:02.739128 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:02.749722 18369 raft_consensus.cc:3032] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:02.769801 18229 raft_consensus.cc:686] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [term 4 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:02.770392 18274 consensus_queue.cc:1035] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:02.771488 18016 consensus_queue.cc:1046] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:02.772081 18439 consensus_queue.cc:1046] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:02.875164 17236 raft_consensus.cc:1226] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:02.773195 18463 raft_consensus.cc:729] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:02.744455 18438 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.788856 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 213) took 3848 ms. Trace:
I20260929 11:37:02.780496 18464 consensus_queue.cc:1035] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260929 11:37:02.764256 17317 raft_consensus.cc:3037] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:02.747274 18449 consensus_queue.cc:1046] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260929 11:37:02.858065 17242 raft_consensus.cc:1226] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:02.872243 18403 consensus_queue.cc:1046] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260929 11:37:02.909597 17242 raft_consensus.cc:1226] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260929 11:37:02.860952 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 63355.3us
I20260929 11:37:02.725565 17309 rpcz_store.cc:276] 0929 11:37:00.759767 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.378658 (+1618891us) service_pool.cc:227] Handling call
0929 11:37:02.379062 (+ 404us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.467621 (+ 88559us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.672746 (+205125us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:02.858137 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 68422.1us
I20260929 11:37:02.747777 17310 rpcz_store.cc:276] 0929 11:37:01.488604 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.419057 (+930453us) service_pool.cc:227] Handling call
0929 11:37:02.446494 (+ 27437us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.603333 (+156839us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.619549 (+ 16216us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:02.858067 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 72397.2us
W20260929 11:37:02.875758 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 191174us
I20260929 11:37:02.876296 17240 raft_consensus.cc:2396] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:02.877141 17312 raft_consensus.cc:1261] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260929 11:37:02.878783 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 107273us
I20260929 11:37:02.914881 17312 raft_consensus.cc:1261] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:02.892714 17243 raft_consensus.cc:1261] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260929 11:37:02.873566 18460 log.cc:924] Time spent T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.126s user 0.003s sys 0.000s
I20260929 11:37:02.864275 18145 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.864162 18182 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:02.765297 17237 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
W20260929 11:37:02.868682 18240 consensus_meta.cc:287] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.618s user 0.013s sys 0.001s
I20260929 11:37:02.872097 18192 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.774363 18315 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.738502 18348 consensus_queue.cc:237] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:02.866794 17318 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:02.867535 17384 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:02.897086 18463 consensus_queue.cc:260] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:02.897866 18452 consensus_queue.cc:260] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:02.882660 18174 raft_consensus.cc:3032] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:02.873564 17461 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
W20260929 11:37:02.889353 17383 consensus_meta.cc:287] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.504s user 0.010s sys 0.000s
I20260929 11:37:02.880642 18369 raft_consensus.cc:729] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:02.900811 18229 consensus_queue.cc:237] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.907183 17457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 305) took 2268 ms. Trace:
I20260929 11:37:02.885301 17234 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:02.920410 18355 consensus_queue.cc:237] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:02.920077 18181 consensus_queue.cc:1035] T 0fbfc6a09e844768909a2044d9cb8066 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260929 11:37:02.922969 18285 consensus_meta.cc:287] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.662s user 0.010s sys 0.003s
I20260929 11:37:02.924187 17391 raft_consensus.cc:1261] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:02.901340 18016 consensus_queue.cc:1225] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer 013a37bea2eb40c0ad4ce8f296176573 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260929 11:37:02.926856 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:02.927250 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:02.927388 17207 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:02.871979 18373 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.971875 17457 rpcz_store.cc:276] 0929 11:37:00.638609 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.719085 (+1080476us) service_pool.cc:227] Handling call
0929 11:37:01.777021 (+ 57936us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.385620 (+608599us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.906514 (+520894us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000311d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:02.907119 (+ 605us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1083187584}
I20260929 11:37:02.953044 18006 consensus_queue.cc:1035] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.026s
I20260929 11:37:02.992123 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:02.992930 18315 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:02.993757 17457 raft_consensus.cc:1261] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:02.993544 18346 consensus_queue.cc:260] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:37:02.994594 18307 consensus_meta.cc:287] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.701s user 0.012s sys 0.000s
I20260929 11:37:02.979598 18197 consensus_queue.cc:1035] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260929 11:37:02.963848 18174 raft_consensus.cc:729] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:02.964232 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:02.908283 17316 raft_consensus.cc:1261] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:02.939129 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:02.952598 18145 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.007579 17466 raft_consensus.cc:2379] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:02.938516 17208 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:02.955585 17312 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:02.957765 17463 raft_consensus.cc:1261] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:02.955165 18192 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:03.011631 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 73210.7us
I20260929 11:37:02.952178 18310 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:02.971077 17355 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:37:02.979576 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 66682.1us
I20260929 11:37:02.989877 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:02.990185 17388 raft_consensus.cc:2396] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260929 11:37:02.990595 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 63296.3us
I20260929 11:37:03.003273 17239 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:02.990973 17243 raft_consensus.cc:1261] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260929 11:37:02.907742 18217 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.001060 17313 raft_consensus.cc:1226] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:03.016727 18371 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:02.954973 18274 consensus_queue.cc:1035] T 8c68e526f10e41d28e5d99b4d239f940 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260929 11:37:02.970286 17383 raft_consensus.cc:2454] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:02.952407 18240 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:02.881364 18447 consensus_queue.cc:1046] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260929 11:37:02.978137 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:02.903889 17392 rpcz_store.cc:276] 0929 11:36:58.940457 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.662190 (+2721733us) service_pool.cc:227] Handling call
0929 11:37:01.716672 (+ 54482us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.363753 (+647081us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.788518 (+424765us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400280354. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:02.788756 (+ 238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1326040832}
I20260929 11:37:02.864424 18450 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:02.980198 18463 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:03.013703 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 72771.2us
I20260929 11:37:03.029237 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:03.006376 18181 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.014238 17356 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:03.013721 17208 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:03.003109 18457 raft_consensus.cc:2781] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:02.987672 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:37:02.990739 18465 log.cc:924] Time spent T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
W20260929 11:37:03.034525 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 63556.5us
I20260929 11:37:03.065460 17313 raft_consensus.cc:1226] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:03.033123 17283 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:02.969439 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:03.035425 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:03.039500 17317 raft_consensus.cc:1261] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:02.983136 18285 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:03.032671 17310 raft_consensus.cc:1226] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:03.012209 17460 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:03.049983 17459 raft_consensus.cc:2362] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3. Re-sending same reply.
I20260929 11:37:03.079553 17314 raft_consensus.cc:1226] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:03.036792 18310 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.050450 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:03.052042 18240 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:03.052580 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:03.053395 18294 consensus_meta.cc:287] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.796s user 0.007s sys 0.010s
I20260929 11:37:03.040863 18412 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:03.053213 18274 consensus_queue.cc:1035] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260929 11:37:03.042790 18217 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:03.069471 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 55346.9us
I20260929 11:37:03.071210 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 278) took 1477 ms. Trace:
I20260929 11:37:03.077925 17237 raft_consensus.cc:2379] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:03.078418 18373 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:37:03.060652 18259 consensus_meta.cc:287] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.765s user 0.007s sys 0.005s
I20260929 11:37:03.060127 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:03.082476 18285 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:03.093151 17283 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.061280 18457 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:03.068603 17431 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.103085 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:37:03.120499 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 51985.2us
I20260929 11:37:03.103179 17317 rpcz_store.cc:276] 0929 11:37:01.593709 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.444559 (+850850us) service_pool.cc:227] Handling call
0929 11:37:02.444879 (+ 320us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:03.070957 (+626078us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:03.071155 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:03.074433 18443 raft_consensus.cc:2781] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:03.126523 17283 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.068210 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:03.074947 18027 raft_consensus.cc:2726] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:03.033066 18369 consensus_queue.cc:260] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.108448 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:03.085142 17207 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
W20260929 11:37:03.123849 18466 log.cc:924] Time spent T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260929 11:37:03.103916 18412 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:03.102603 18240 raft_consensus.cc:2781] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:03.128551 17283 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.117935 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:03.064910 18181 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:03.055233 18174 consensus_queue.cc:260] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:03.118302 18259 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:03.133643 18443 raft_consensus.cc:686] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:03.154937 17236 raft_consensus.cc:2396] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:03.127321 18457 raft_consensus.cc:3037] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:03.135299 18479 raft_consensus.cc:2726] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.136826 18369 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:37:03.140235 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 55172.5us
I20260929 11:37:03.097414 18299 consensus_queue.cc:1046] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260929 11:37:03.117339 17457 raft_consensus.cc:3032] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:37:03.205871 17207 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:03.118678 18438 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:03.100294 18302 consensus_queue.cc:1046] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260929 11:37:03.119264 17234 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:03.105690 18470 consensus_queue.cc:1035] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260929 11:37:03.175738 18181 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:03.117156 18294 consensus_queue.cc:1046] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260929 11:37:03.185236 18174 raft_consensus.cc:3037] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:03.180721 17462 raft_consensus.cc:1261] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:03.145282 18371 raft_consensus.cc:686] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:03.153175 18373 raft_consensus.cc:2726] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.154753 18240 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:03.153379 18412 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:03.147354 18480 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.155537 18403 raft_consensus.cc:2726] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:37:03.181054 18197 raft_consensus.cc:2726] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:03.228742 17207 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.178354 18259 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:03.141619 18444 consensus_queue.cc:1035] T ece37243cd8c44acaf6b92a5deb1274d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260929 11:37:03.333191 17386 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:03.178798 18472 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:03.334560 18181 raft_consensus.cc:2726] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:03.334375 18472 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:03.128906 18285 raft_consensus.cc:2726] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:03.183038 18145 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:03.183336 18182 raft_consensus.cc:686] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:03.191368 17315 raft_consensus.cc:1226] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:03.181730 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:03.337033 17310 raft_consensus.cc:2396] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:03.336658 18182 consensus_queue.cc:237] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:03.236706 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:03.205495 17457 raft_consensus.cc:729] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:03.209036 18274 raft_consensus.cc:2726] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.205937 17235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 243) took 2321 ms. Trace:
W20260929 11:37:03.238180 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 110126us
W20260929 11:37:03.191128 18080 consensus_queue.cc:1159] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "26cd298fcaa34c9f93d8793e64f0e863" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260929 11:37:03.329739 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 101124us
I20260929 11:37:03.347350 17207 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:03.347894 17283 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.241672 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:03.330742 18485 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
W20260929 11:37:03.331591 18493 log.cc:924] Time spent T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
I20260929 11:37:03.235836 18486 consensus_queue.cc:1035] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.108s
I20260929 11:37:03.239459 17239 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:03.241056 18240 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
W20260929 11:37:03.330322 18494 log.cc:924] Time spent T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260929 11:37:03.367542 17283 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.325671 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:03.385195 17283 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:03.324386 18491 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:03.363961 18294 raft_consensus.cc:2726] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.326010 18137 consensus_queue.cc:1035] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.052s
W20260929 11:37:03.408185 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 62413.8us
I20260929 11:37:03.422874 17283 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:03.427601 17313 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:03.328136 18480 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:03.428990 17313 raft_consensus.cc:1261] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260929 11:37:03.435171 17283 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:03.401432 18470 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.435628 18480 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:03.418926 18299 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.352463 17457 consensus_queue.cc:260] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:03.350385 17235 rpcz_store.cc:276] 0929 11:37:00.884268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.394763 (+1510495us) service_pool.cc:227] Handling call
0929 11:37:02.449739 (+ 54976us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:02.455836 (+ 6097us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.463872 (+ 8036us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:02.693949 (+230077us) log.cc:842] Serialized 26 byte log entry
0929 11:37:02.871506 (+177557us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:03.002526 (+131020us) log.cc:842] Serialized 14 byte log entry
0929 11:37:03.014195 (+ 11669us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:03.029631 (+ 15436us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:03.181233 (+151602us) raft_consensus.cc:1671] finished
0929 11:37:03.181258 (+ 25us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:03.191489 (+ 10231us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3062,"prepare.queue_time_us":321844,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":116,"raft.queue_time_us":11928,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":20438,"thread_start_us":257451,"threads_started":2,"wal-append.queue_time_us":264539}
I20260929 11:37:03.372879 18274 consensus_queue.cc:1035] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260929 11:37:03.437204 17383 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:03.420084 18027 raft_consensus.cc:2781] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:03.369769 18485 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:03.439087 17310 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260929 11:37:03.400089 18371 consensus_queue.cc:237] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:03.441362 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 88201.3us
I20260929 11:37:03.411633 18496 raft_consensus.cc:2726] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.417816 18475 raft_consensus.cc:2726] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:03.371929 18181 consensus_queue.cc:1035] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260929 11:37:03.324259 18443 consensus_queue.cc:237] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:03.486603 17384 pending_rounds.cc:76] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Aborting all ops after (but not including) 1
I20260929 11:37:03.491948 18263 raft_consensus.cc:3032] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Stepping down as leader of term 4
I20260929 11:37:03.492153 17384 pending_rounds.cc:97] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260929 11:37:03.492479 18263 raft_consensus.cc:729] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:03.492713 17384 raft_consensus.cc:2866] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:37:03.444463 18145 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:03.435371 18294 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.444891 18229 consensus_queue.cc:1035] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260929 11:37:03.430792 18373 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.430600 18182 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:03.449723 17457 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:03.434785 18259 raft_consensus.cc:2726] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:03.453462 17238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 242) took 2270 ms. Trace:
W20260929 11:37:03.456276 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 457700us
I20260929 11:37:03.441219 17283 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.474299 18485 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:03.450220 18299 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:03.521054 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 79903.8us
I20260929 11:37:03.461109 18027 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:03.443806 18444 consensus_queue.cc:1046] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260929 11:37:03.491007 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:03.425973 18491 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.446192 18470 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:03.511504 18412 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.491453 18240 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:03.516341 17431 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.522195 17283 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:03.502290 18454 raft_consensus.cc:3032] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Stepping down as leader of term 3
W20260929 11:37:03.583117 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 62448.2us
I20260929 11:37:03.587249 17463 raft_consensus.cc:1261] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260929 11:37:03.522627 17238 rpcz_store.cc:276] 0929 11:37:01.183112 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.405867 (+1222755us) service_pool.cc:227] Handling call
0929 11:37:02.436446 (+ 30579us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.437123 (+ 677us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:03.453159 (+1016036us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b54007026d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:03.453374 (+ 215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8219904}
I20260929 11:37:03.600704 18259 consensus_queue.cc:1035] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:03.601227 18444 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.601948 18444 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.604159 18342 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:03.604764 18342 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:03.606570 18342 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:03.493376 18263 consensus_queue.cc:260] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:03.610572 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 88450.8us
W20260929 11:37:03.583444 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 62583.4us
W20260929 11:37:03.613294 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 97084.2us
I20260929 11:37:03.527702 18027 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:03.588595 17462 raft_consensus.cc:2379] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:03.524016 18475 raft_consensus.cc:2726] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.609243 17317 raft_consensus.cc:1261] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:03.612157 17283 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:03.630652 17431 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.586488 18454 raft_consensus.cc:729] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:03.585664 18274 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.501013 18294 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.606577 18470 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:03.660871 18507 consensus_queue.cc:1046] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:03.661389 18491 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:03.661686 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 210) took 3545 ms. Trace:
I20260929 11:37:03.662354 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:03.663154 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:03.663894 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:03.523291 18181 consensus_queue.cc:1035] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
W20260929 11:37:03.654572 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 67701us
I20260929 11:37:03.644910 18393 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:03.618346 18447 raft_consensus.cc:2726] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.685060 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:03.641651 18263 raft_consensus.cc:3037] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
W20260929 11:37:03.659287 18442 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.668s user 0.000s sys 0.044s
I20260929 11:37:03.643311 18490 raft_consensus.cc:2726] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:03.688351 17208 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:03.611325 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:03.520107 18373 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:03.644711 18444 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:03.519522 18182 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:03.682562 18247 raft_consensus.cc:3032] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Stepping down as leader of term 2
W20260929 11:37:03.642371 18174 consensus_queue.cc:1159] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a7e500c82a21469ab59f66205205a12a" responder_term: 5 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: [4.2-4.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260929 11:37:03.705046 17460 raft_consensus.cc:1226] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260929 11:37:03.706136 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:03.683131 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:03.685631 18491 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:03.707818 17387 consensus_meta.cc:287] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.570s user 0.010s sys 0.001s
I20260929 11:37:03.721815 18443 raft_consensus.cc:482] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.688661 18475 consensus_queue.cc:1046] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260929 11:37:03.730154 18341 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:03.749362 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:03.709111 18442 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.708s user 0.000s sys 0.044s
I20260929 11:37:03.749683 17239 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:03.775507 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:03.697736 18454 consensus_queue.cc:260] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:03.644142 18505 consensus_queue.cc:1035] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260929 11:37:03.761547 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:03.729809 18444 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.719478 18192 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:37:03.777535 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 89299.1us
I20260929 11:37:03.697304 18470 consensus_queue.cc:1035] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260929 11:37:03.757970 18467 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.757591 18161 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.750056 17318 raft_consensus.cc:1226] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260929 11:37:03.863919 18516 log.cc:924] Time spent T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.056s user 0.000s sys 0.001s
I20260929 11:37:03.713900 18426 consensus_queue.cc:1035] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260929 11:37:03.723510 18247 raft_consensus.cc:729] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:03.682176 17311 rpcz_store.cc:276] 0929 11:37:00.115881 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.247540 (+2131659us) service_pool.cc:227] Handling call
0929 11:37:02.285100 (+ 37560us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:02.440861 (+155761us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:03.661390 (+1220529us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540007c954. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:03.661628 (+ 238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":274728832}
I20260929 11:37:03.664887 18274 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:03.807899 17317 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:03.757628 17357 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:03.866142 18412 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:37:03.834692 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 188254us
I20260929 11:37:03.764985 18506 consensus_queue.cc:1035] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260929 11:37:03.805495 18294 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:03.813511 18486 raft_consensus.cc:2781] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:03.866778 17431 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:03.871435 17356 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:03.776126 18491 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.819880 18455 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.811545 18521 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:37:03.803781 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 189420us
W20260929 11:37:03.920262 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 53614.6us
I20260929 11:37:03.822729 18299 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:03.923182 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:03.925417 17464 raft_consensus.cc:3032] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:03.869995 18285 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.884605 18530 consensus_queue.cc:1046] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260929 11:37:03.863888 18137 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.798062 18443 raft_consensus.cc:504] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.869503 18240 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:03.896246 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 138696us
I20260929 11:37:03.917275 17957 raft_consensus.cc:2726] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260929 11:37:03.891144 18527 log.cc:924] Time spent T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.057s user 0.000s sys 0.001s
I20260929 11:37:03.882066 18454 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:03.905058 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:03.942220 17317 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 5
I20260929 11:37:03.906381 18294 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.907279 18274 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:03.900960 18307 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260929 11:37:03.908915 18512 log.cc:924] Time spent T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.133s user 0.000s sys 0.000s
I20260929 11:37:03.910548 17311 raft_consensus.cc:1226] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:03.911180 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:03.968626 17239 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:03.969566 18443 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:03.970009 18393 raft_consensus.cc:2726] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.970220 17239 raft_consensus.cc:1261] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260929 11:37:03.911725 18511 log.cc:924] Time spent T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.267s user 0.001s sys 0.000s
I20260929 11:37:03.911382 18027 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.883441 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:03.901697 17355 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:37:03.916220 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 44869.9us
I20260929 11:37:03.817715 18341 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:37:04.003644 18520 log.cc:924] Time spent T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.058s user 0.000s sys 0.001s
I20260929 11:37:03.899668 18475 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:03.925804 17464 raft_consensus.cc:729] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:04.004760 18475 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.005137 17464 consensus_queue.cc:260] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.005576 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.006121 17464 raft_consensus.cc:3037] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:04.006814 18475 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:03.881088 18444 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.886296 18161 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:03.934478 18137 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.009742 18161 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.009840 18137 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:03.932770 18145 raft_consensus.cc:2726] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:03.924862 18521 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:03.934157 17357 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
W20260929 11:37:04.011423 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 77370.4us
I20260929 11:37:04.012156 18521 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:04.012462 18531 log.cc:924] Time spent T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.079s user 0.000s sys 0.001s
I20260929 11:37:04.012748 18521 raft_consensus.cc:2781] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:03.945675 18373 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:03.959329 18307 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:04.013955 18307 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:03.936708 18501 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:03.927064 18455 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.018379 18455 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:03.939256 18533 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:04.019189 17464 raft_consensus.cc:1261] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:04.019061 18533 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.020049 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 215) took 1660 ms. Trace:
I20260929 11:37:03.947811 18294 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:03.931602 18285 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:03.966097 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:03.967548 18478 log.cc:924] Time spent T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.976s user 0.002s sys 0.000s
I20260929 11:37:03.933670 18247 consensus_queue.cc:260] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:03.958163 18523 log.cc:924] Time spent T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.151s user 0.000s sys 0.001s
I20260929 11:37:03.999729 17317 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:04.003283 18529 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.012691 17357 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:03.771701 17387 raft_consensus.cc:2454] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:04.013314 18521 raft_consensus.cc:686] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:03.887332 18467 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.063153 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 227) took 1446 ms. Trace:
I20260929 11:37:03.929878 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:03.925436 18486 raft_consensus.cc:686] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:04.020449 17464 rpcz_store.cc:276] 0929 11:37:02.359246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.464288 (+105042us) service_pool.cc:227] Handling call
0929 11:37:02.464643 (+ 355us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:03.925318 (+1460675us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400320120. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9824730 00007f79b9896300 00007f79b9897371 00007f79b9893edf 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc
0929 11:37:04.019733 (+ 94415us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.019996 (+ 263us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":662293376}
I20260929 11:37:04.068500 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 278) took 1947 ms. Trace:
I20260929 11:37:04.068594 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:37:03.970968 18369 consensus_meta.cc:287] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.778s user 0.011s sys 0.000s
I20260929 11:37:04.006211 17466 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:03.947542 18182 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:03.991371 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 254) took 1359 ms. Trace:
I20260929 11:37:04.053061 18373 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:04.001111 18443 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.057734 18341 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.059156 18294 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.058815 18529 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.021183 18533 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.060585 18521 consensus_queue.cc:237] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:04.066933 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 54312.4us
I20260929 11:37:04.114718 17311 raft_consensus.cc:2396] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:04.076999 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.122529 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.126362 17464 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:04.129344 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.130574 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.069043 17241 rpcz_store.cc:276] 0929 11:37:02.120888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.761043 (+640155us) service_pool.cc:227] Handling call
0929 11:37:02.796010 (+ 34967us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:02.859985 (+ 63975us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:02.860025 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:02.867942 (+ 7917us) log.cc:842] Serialized 26 byte log entry
0929 11:37:02.956377 (+ 88435us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:02.956412 (+ 35us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:02.956491 (+ 79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:03.967022 (+1010531us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b9516bee 00007f79b9515f36 00007f79b9515b58 00007f79b951f551 00007f79b951f509 00007f79b951f499
0929 11:37:04.054093 (+ 87071us) raft_consensus.cc:1671] finished
0929 11:37:04.054113 (+ 20us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:04.068423 (+ 14310us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8219,"spinlock_wait_cycles":14522752,"thread_start_us":53790,"threads_started":1,"wal-append.queue_time_us":102054}
I20260929 11:37:04.071449 18247 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:04.103209 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.044472 18534 raft_consensus.cc:2726] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:04.064203 17318 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:04.063653 18467 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.065892 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:04.072630 18444 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:04.072847 18137 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.039345 18505 consensus_queue.cc:1035] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260929 11:37:04.076803 18486 consensus_queue.cc:237] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.134176 17312 raft_consensus.cc:2379] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:04.102620 18426 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:04.136863 17464 raft_consensus.cc:1261] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:04.154114 18501 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:04.154618 18501 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:04.063637 17309 rpcz_store.cc:276] 0929 11:37:02.617217 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.919595 (+302378us) service_pool.cc:227] Handling call
0929 11:37:02.919930 (+ 335us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:03.709828 (+789898us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b180019b820. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b952382c 00007f79b694e9dc 00007f79bf785a39 00007f79b696b8bb 00007f79b6969cbf 00007f79b6969155 00007f79b988c3d0 00007f79b988cf6b 00007f79b989778b
0929 11:37:03.725229 (+ 15401us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:03.752057 (+ 26828us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:03.864559 (+112502us) log.cc:842] Serialized 26 byte log entry
0929 11:37:03.930596 (+ 66037us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:03.933314 (+ 2718us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:03.933420 (+ 106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:03.965711 (+ 32291us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180019b820. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b696c764 00007f79b696fb11 00007f79b696fac9 00007f79b696fa59 00007f79b696fa21 00007f79b696ed1d 00007f79bfbd0204 00007f79bfbd0039 00007f79b694edc6
0929 11:37:04.062920 (+ 97209us) raft_consensus.cc:1671] finished
0929 11:37:04.062942 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:04.063089 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":60560,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13253,"spinlock_wait_cycles":44568832,"thread_start_us":85543,"threads_started":2,"wal-append.queue_time_us":163920}
I20260929 11:37:04.124931 18299 raft_consensus.cc:2781] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:04.121248 18535 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:04.130760 18442 raft_consensus.cc:2781] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:04.140763 17313 raft_consensus.cc:1261] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:04.141588 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.134871 17235 raft_consensus.cc:1261] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:04.135419 18443 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.165354 17466 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:04.145382 17460 raft_consensus.cc:2379] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:04.163467 17237 raft_consensus.cc:1261] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:04.078635 17384 rpcz_store.cc:276] 0929 11:37:02.611856 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.431581 (+819725us) service_pool.cc:227] Handling call
0929 11:37:03.459409 (+ 27828us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:03.493512 (+ 34103us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:03.493567 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:03.586584 (+ 93017us) log.cc:842] Serialized 26 byte log entry
0929 11:37:03.768207 (+181623us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:03.775274 (+ 7067us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:03.799900 (+ 24626us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:03.943753 (+143853us) raft_consensus.cc:1671] finished
0929 11:37:03.943777 (+ 24us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:03.971425 (+ 27648us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":134997,"threads_started":1,"wal-append.queue_time_us":203333}
I20260929 11:37:04.137387 18491 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.178848 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:04.176834 18443 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.145061 18137 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.164175 18442 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:04.162256 18355 raft_consensus.cc:3032] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:04.175876 17466 raft_consensus.cc:1261] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:04.176800 18027 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.177424 18426 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.163328 18299 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:04.123392 18373 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.180157 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:37:04.221828 17457 consensus_meta.cc:287] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.697s user 0.009s sys 0.001s
W20260929 11:37:04.218997 18484 log.cc:924] Time spent T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 1.009s user 0.002s sys 0.000s
I20260929 11:37:04.230693 18299 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:04.223382 18217 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:37:04.222445 18457 consensus_meta.cc:287] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 1.013s user 0.007s sys 0.005s
I20260929 11:37:04.241899 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.214815 18426 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.220566 17318 raft_consensus.cc:1226] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:04.215154 18285 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.249750 18285 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.250208 18285 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.216305 18473 raft_consensus.cc:3032] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:04.184530 18442 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:04.252607 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 224) took 2095 ms. Trace:
I20260929 11:37:04.184445 18355 raft_consensus.cc:729] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:04.262724 17314 rpcz_store.cc:276] 0929 11:37:02.156732 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.603919 (+447187us) service_pool.cc:227] Handling call
0929 11:37:02.617670 (+ 13751us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:03.080005 (+462335us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.252294 (+1172289us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54005cab54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:04.252523 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1061714688}
I20260929 11:37:04.261848 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.238922 18530 consensus_queue.cc:1225] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer bb8e3505668b40219823840c0d8bc3af log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
W20260929 11:37:04.265369 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 398867us
I20260929 11:37:04.214380 18307 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.275703 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:04.276403 17384 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:04.274173 18505 consensus_queue.cc:1046] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260929 11:37:04.272308 18373 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:04.276860 18529 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.260526 18457 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.272696 17457 raft_consensus.cc:1261] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:04.286012 18310 leader_election.cc:288] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.286128 18137 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:04.260169 18473 raft_consensus.cc:729] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:04.263720 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 253) took 1650 ms. Trace:
I20260929 11:37:04.168805 18535 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:04.291941 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:04.262193 18182 consensus_queue.cc:1035] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260929 11:37:04.274612 17283 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:04.286731 17457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 240) took 1231 ms. Trace:
I20260929 11:37:04.304628 17206 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:04.293743 18299 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.277988 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:04.278523 18161 consensus_queue.cc:1046] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260929 11:37:04.287880 18449 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260929 11:37:04.293745 18285 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.279059 18457 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.322630 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.322613 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.308830 18475 raft_consensus.cc:2781] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:04.325635 17466 raft_consensus.cc:1261] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:04.317898 18259 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.329123 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.329762 17313 raft_consensus.cc:2454] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 1.
I20260929 11:37:04.332742 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:37:04.333611 17283 leader_election.cc:334] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 2.207s (SENT)
I20260929 11:37:04.337692 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.338778 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.297202 18473 consensus_queue.cc:260] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.340062 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.336860 17283 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:04.290231 17388 rpcz_store.cc:276] 0929 11:37:02.611551 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.783823 (+172272us) service_pool.cc:227] Handling call
0929 11:37:04.262169 (+1478346us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000e6d54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:04.262334 (+ 165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":254406912}
I20260929 11:37:04.328109 18475 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:04.305346 17457 rpcz_store.cc:276] 0929 11:37:03.055075 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.060387 (+ 5312us) service_pool.cc:227] Handling call
0929 11:37:03.096046 (+ 35659us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:04.286428 (+1190382us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.286660 (+ 232us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:04.319604 18192 consensus_queue.cc:1035] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260929 11:37:04.319594 18469 consensus_queue.cc:1035] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260929 11:37:04.365825 17283 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:04.341075 17238 raft_consensus.cc:2396] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:04.389357 17356 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:37:04.392182 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 45984.8us
I20260929 11:37:04.395656 17206 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:04.307381 18355 consensus_queue.cc:260] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.399981 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.366418 18310 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.365904 18467 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:04.409051 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:04.409978 17238 raft_consensus.cc:2379] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:04.404531 18549 raft_consensus.cc:2781] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260929 11:37:04.410775 18549 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:04.410900 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:04.411304 18549 raft_consensus.cc:3037] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:04.411531 17384 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:04.412001 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:04.412680 18310 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.413451 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:04.414552 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:04.388753 18027 raft_consensus.cc:2726] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:04.417007 18310 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.417778 17384 raft_consensus.cc:1261] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260929 11:37:04.419574 17384 pending_rounds.cc:76] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af: Aborting all ops after (but not including) 1
I20260929 11:37:04.404881 18365 consensus_queue.cc:1035] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260929 11:37:04.404688 18373 raft_consensus.cc:2781] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:04.390985 18509 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.424703 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.425370 17313 raft_consensus.cc:2454] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:04.427261 17283 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:04.399168 18145 raft_consensus.cc:2726] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:04.336002 18259 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.429518 17431 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:04.434110 17283 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:04.435060 17206 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:37:04.438643 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 537274us
I20260929 11:37:04.398515 18475 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:04.407348 18519 raft_consensus.cc:2781] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:04.400955 18302 consensus_queue.cc:1035] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260929 11:37:04.428979 18355 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:04.431962 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 265) took 4535 ms. Trace:
I20260929 11:37:04.452121 18535 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.452637 18299 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.411630 17238 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:04.454442 18501 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.432368 18509 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.446382 18519 raft_consensus.cc:482] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:04.428530 18341 consensus_queue.cc:1035] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.029s
I20260929 11:37:04.443993 18534 raft_consensus.cc:2726] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:04.421416 17384 pending_rounds.cc:97] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260929 11:37:04.443476 18307 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.443138 18027 raft_consensus.cc:2726] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:04.427984 18467 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:04.502185 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 68180.9us
W20260929 11:37:04.536657 17207 leader_election.cc:334] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Timed out: RequestConsensusVote RPC to 127.13.221.196:39599 timed out after 1.653s (SENT)
I20260929 11:37:04.440459 18526 consensus_queue.cc:1035] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260929 11:37:04.500669 17314 raft_consensus.cc:1226] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:04.454862 18522 raft_consensus.cc:2781] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:04.487171 17355 leader_election.cc:302] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:37:04.501926 18541 log.cc:924] Time spent T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.111s user 0.001s sys 0.000s
I20260929 11:37:04.484997 18469 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.499439 18509 leader_election.cc:288] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.486507 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:04.457211 18442 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.460371 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:04.538805 17283 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:04.536633 18519 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:04.628118 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 141024us
I20260929 11:37:04.536065 17384 raft_consensus.cc:2866] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260929 11:37:04.639127 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 100391us
I20260929 11:37:04.637600 18560 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:04.648805 18560 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:04.639947 18526 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.649214 18560 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:04.649443 18526 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:04.651619 18526 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.546700 18549 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.559558 18444 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.568701 18462 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:04.653954 18532 log.cc:924] Time spent T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.767s user 0.001s sys 0.000s
I20260929 11:37:04.647197 18469 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.653918 18462 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:04.636771 18355 raft_consensus.cc:2781] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:04.656195 18549 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.656558 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:04.656699 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.663938 17466 raft_consensus.cc:2379] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:04.664076 17462 raft_consensus.cc:2379] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:04.656889 17463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 247) took 1051 ms. Trace:
I20260929 11:37:04.653047 18444 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:04.664654 17463 rpcz_store.cc:276] 0929 11:37:03.605780 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.609211 (+ 3431us) service_pool.cc:227] Handling call
0929 11:37:03.642731 (+ 33520us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:03.665384 (+ 22653us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:03.665426 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:03.683507 (+ 18081us) log.cc:842] Serialized 26 byte log entry
0929 11:37:03.729421 (+ 45914us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:03.729470 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:03.729558 (+ 88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:04.653418 (+923860us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b9516bee 00007f79b9515f36 00007f79b9515b58 00007f79b951f551 00007f79b951f509 00007f79b951f499
0929 11:37:04.656620 (+ 3202us) raft_consensus.cc:1671] finished
0929 11:37:04.656641 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:04.656831 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22201,"raft.queue_time_us":28401,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5379,"spinlock_wait_cycles":4639616,"thread_start_us":15587,"threads_started":1,"wal-append.queue_time_us":102174}
I20260929 11:37:04.546700 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:37:04.669183 17207 leader_election.cc:334] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599): Timed out: RequestConsensusVote RPC to 127.13.221.196:39599 timed out after 1.743s (SENT)
I20260929 11:37:04.672900 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.673358 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.661769 17388 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:04.655755 18462 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.667068 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.569463 18467 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.611394 18259 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.582659 18530 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:04.677600 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 294) took 1185 ms. Trace:
I20260929 11:37:04.677688 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.675798 17207 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:04.695971 18549 raft_consensus.cc:2726] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:04.677205 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 229) took 1999 ms. Trace:
I20260929 11:37:04.681764 17466 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:04.696806 17384 rpcz_store.cc:276] 0929 11:37:02.677517 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.415450 (+1737933us) service_pool.cc:227] Handling call
0929 11:37:04.416488 (+ 1038us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:04.648258 (+231770us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.672889 (+ 24631us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:04.695112 17310 rpcz_store.cc:276] 0929 11:37:03.489399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.493835 (+ 4436us) service_pool.cc:227] Handling call
0929 11:37:03.508801 (+ 14966us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:03.509083 (+ 282us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:03.680627 (+171544us) log.cc:842] Serialized 14 byte log entry
0929 11:37:04.620896 (+940269us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b1800252760. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b68e34ca 00007f79bffc4f99 00007f79b67a7990 00007f79b6969864 00007f79b6969155 00007f79bd269167 00007f79b989e807 00007f79b98adf0f 00007f79b98ade88
0929 11:37:04.621219 (+ 323us) log.cc:842] Serialized 14 byte log entry
0929 11:37:04.639013 (+ 17794us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:04.641147 (+ 2134us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:04.646506 (+ 5359us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.656634 (+ 10128us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:04.674726 (+ 18092us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33451,"prepare.queue_time_us":1000027,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":30711,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":10184,"spinlock_wait_cycles":21052672,"thread_start_us":169444,"threads_started":1}
I20260929 11:37:04.627868 18522 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:04.698101 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:04.698273 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.662098 18469 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.682749 18444 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.699314 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:04.699543 17283 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:04.699728 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.457538 17315 rpcz_store.cc:276] 0929 11:36:59.896169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.822058 (+1925889us) service_pool.cc:227] Handling call
0929 11:37:01.886569 (+ 64511us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:03.336574 (+1450005us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.404776 (+1068202us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540002bcd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:04.428520 (+ 23744us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2972934912}
I20260929 11:37:04.698287 18530 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.691201 18442 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:04.700876 17355 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:04.700876 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.701994 17315 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:04.702538 18444 raft_consensus.cc:2726] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:04.702415 18475 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.702996 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.703241 18444 consensus_queue.cc:1046] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:04.657167 18145 raft_consensus.cc:2726] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:04.704293 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.705216 17315 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:04.705631 18525 raft_consensus.cc:3032] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:37:04.705816 18469 raft_consensus.cc:2726] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260929 11:37:04.558609 18551 log.cc:924] Time spent T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.126s user 0.001s sys 0.000s
I20260929 11:37:04.706256 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.698482 18522 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:04.707252 17355 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:04.708074 18341 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:04.698899 18259 consensus_queue.cc:1035] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:04.675338 17239 raft_consensus.cc:2379] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:04.707931 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:04.656287 18355 raft_consensus.cc:686] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:04.709884 17355 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:04.711217 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.710999 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:04.682564 18557 log.cc:924] Time spent T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260929 11:37:04.743839 18442 raft_consensus.cc:2726] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260929 11:37:04.745522 17240 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 250) took 3023 ms (client timeout 3173 ms). Trace:
I20260929 11:37:04.751057 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:04.751941 17239 raft_consensus.cc:2379] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:04.746809 17241 raft_consensus.cc:1261] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260929 11:37:04.752380 17241 pending_rounds.cc:76] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573: Aborting all ops after (but not including) 1
I20260929 11:37:04.752614 17241 pending_rounds.cc:97] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260929 11:37:04.748226 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.741474 17238 raft_consensus.cc:2379] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:04.753772 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:04.753821 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:04.754941 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:04.755085 18560 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:04.755831 17238 raft_consensus.cc:2396] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260929 11:37:04.741919 18512 log.cc:924] Time spent T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
W20260929 11:37:04.751516 17240 rpcz_store.cc:269] 0929 11:37:01.721933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.247807 (+525874us) service_pool.cc:227] Handling call
0929 11:37:04.745228 (+2497421us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54004605d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:04.745441 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1427417984}
I20260929 11:37:04.748955 18355 consensus_queue.cc:237] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:04.758087 17240 raft_consensus.cc:1226] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:04.752781 17311 raft_consensus.cc:3032] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:04.706058 18525 raft_consensus.cc:729] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:04.752835 17241 raft_consensus.cc:2866] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260929 11:37:04.782111 17431 leader_election.cc:334] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 1.839s (SENT)
I20260929 11:37:04.781884 17356 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:04.708274 18452 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:04.708525 18341 raft_consensus.cc:482] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:04.709220 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:04.785205 17431 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:04.724792 18530 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:04.752826 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
W20260929 11:37:04.710229 17236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 246) took 1784 ms (client timeout 2182 ms). Trace:
I20260929 11:37:04.749890 17315 raft_consensus.cc:3037] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:04.771392 17311 raft_consensus.cc:729] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:04.792603 18450 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:04.795428 18472 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:04.796870 17207 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:04.825913 17207 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:04.788471 18307 raft_consensus.cc:2726] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:04.797367 18529 raft_consensus.cc:2726] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:04.792253 17310 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 5: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:04.800465 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:04.800720 17389 raft_consensus.cc:3032] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:04.833413 17389 raft_consensus.cc:729] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:04.802615 17459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 231) took 1121 ms. Trace:
I20260929 11:37:04.803225 17464 raft_consensus.cc:1226] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:04.804996 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.818701 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 222) took 2660 ms. Trace:
I20260929 11:37:04.809904 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:04.817814 17383 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 179) took 1893 ms (client timeout 2106 ms). Trace:
W20260929 11:37:04.815990 17465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32868 (request call id 224) took 1875 ms (client timeout 1743 ms). Trace:
W20260929 11:37:04.841517 17465 rpcz_store.cc:269] 0929 11:37:02.940114 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.815766 (+1875652us) service_pool.cc:214] Skipping call since client already timed out
0929 11:37:04.815907 (+ 141us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260929 11:37:04.841784 17313 raft_consensus.cc:2379] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:04.820923 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:04.787568 18535 consensus_queue.cc:1046] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260929 11:37:04.822523 17239 raft_consensus.cc:3037] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:04.840541 17318 raft_consensus.cc:2379] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:04.824203 18560 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:04.829502 17207 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:04.789605 17312 raft_consensus.cc:1226] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260929 11:37:04.790707 18341 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:04.835552 17389 consensus_queue.cc:260] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:04.788297 18475 leader_election.cc:288] T 3c629677b9d54b97a292b8e5388288eb P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:37:04.808054 18559 log.cc:924] Time spent T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.199s user 0.001s sys 0.001s
W20260929 11:37:04.820302 17236 rpcz_store.cc:269] 0929 11:37:02.926032 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.952848 (+ 26816us) service_pool.cc:227] Handling call
0929 11:37:04.710028 (+1757180us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b5400045e54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:04.710167 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":66308480}
I20260929 11:37:04.831278 18371 raft_consensus.cc:2726] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:04.930568 17312 raft_consensus.cc:1261] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:04.967707 17389 raft_consensus.cc:3037] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:04.840210 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 234) took 1086 ms. Trace:
W20260929 11:37:04.970142 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 140734us
I20260929 11:37:04.999660 17207 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:05.001494 17207 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:04.934412 17313 raft_consensus.cc:1226] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
W20260929 11:37:04.968504 18275 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260929 11:37:04.833616 18530 consensus_queue.cc:1035] T 119bbba610844188b3191eb62136fae2 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260929 11:37:04.848043 18529 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:04.841835 17391 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:04.987849 18457 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:04.931003 18535 consensus_queue.cc:1225] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer 013a37bea2eb40c0ad4ce8f296176573 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260929 11:37:04.863999 17383 rpcz_store.cc:269] 0929 11:37:02.924402 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.059507 (+135105us) service_pool.cc:227] Handling call
0929 11:37:04.817621 (+1758114us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54004c9ad4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:04.817753 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":247331584}
I20260929 11:37:05.052488 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:05.018518 18548 raft_consensus.cc:2726] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:05.073292 17283 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:05.023113 18371 raft_consensus.cc:2726] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:05.109607 18474 raft_consensus.cc:3037] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:05.019783 18229 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:05.023006 17389 raft_consensus.cc:1261] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:04.969571 18444 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.031718 18457 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:04.860493 18525 consensus_queue.cc:260] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:05.044267 17310 raft_consensus.cc:1226] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:05.242394 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 249) took 2762 ms. Trace:
W20260929 11:37:05.045492 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 183) took 2113 ms (client timeout 1839 ms). Trace:
I20260929 11:37:05.035980 18529 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:05.247869 18448 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260929 11:37:04.841277 17316 rpcz_store.cc:276] 0929 11:37:02.157787 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.763261 (+605474us) service_pool.cc:227] Handling call
0929 11:37:02.773974 (+ 10713us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:03.010279 (+236305us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.818438 (+1808159us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540026fa54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:04.818639 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":247158656}
I20260929 11:37:05.230082 18535 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.256541 17389 rpcz_store.cc:276] 0929 11:37:02.358401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.866642 (+508241us) service_pool.cc:227] Handling call
0929 11:37:02.866918 (+ 276us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:04.800623 (+1933705us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540044f820. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9824730 00007f79b9896300 00007f79b9897371 00007f79b9893edf 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc
0929 11:37:05.120539 (+319916us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:05.120824 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":259022720}
I20260929 11:37:05.110675 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:05.234174 18548 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.248065 18457 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:05.250166 18275 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.021461 17207 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: bb8e3505668b40219823840c0d8bc3af
W20260929 11:37:05.371587 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 417826us
W20260929 11:37:05.466025 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 444626us
I20260929 11:37:05.003008 17388 rpcz_store.cc:276] 0929 11:37:03.753416 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.414311 (+660895us) service_pool.cc:227] Handling call
0929 11:37:04.840009 (+425698us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000b7cd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:04.840153 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":531674496}
W20260929 11:37:05.393442 18355 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s user 0.004s sys 0.004s
W20260929 11:37:05.523141 18519 consensus_meta.cc:287] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.875s user 0.004s sys 0.005s
I20260929 11:37:05.523674 18519 raft_consensus.cc:504] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:05.528061 17315 consensus_meta.cc:287] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.702s user 0.005s sys 0.003s
I20260929 11:37:05.412830 18475 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:05.262951 18549 consensus_queue.cc:1046] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.254s
I20260929 11:37:05.246865 18229 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:05.263688 17391 rpcz_store.cc:269] 0929 11:37:02.925523 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.033391 (+107868us) service_pool.cc:227] Handling call
0929 11:37:04.788238 (+1754847us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:05.032445 (+244207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4129664}
W20260929 11:37:05.393925 17240 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s user 0.002s sys 0.005s
I20260929 11:37:05.282310 18530 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
W20260929 11:37:05.559034 17240 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s user 0.002s sys 0.005s
I20260929 11:37:05.249114 18444 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:05.563127 17239 consensus_meta.cc:287] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.631s user 0.009s sys 0.000s
I20260929 11:37:05.565338 17239 raft_consensus.cc:2454] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 5.
I20260929 11:37:05.567364 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:05.568228 17207 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
W20260929 11:37:05.521030 18355 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s user 0.004s sys 0.004s
I20260929 11:37:05.606985 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 332) took 1880 ms. Trace:
I20260929 11:37:05.608291 17389 raft_consensus.cc:2379] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:05.607534 17464 rpcz_store.cc:276] 0929 11:37:03.726567 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.155117 (+428550us) service_pool.cc:227] Handling call
0929 11:37:04.803045 (+647928us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:04.838082 (+ 35037us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:05.606752 (+768670us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400030550. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:05.606916 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1488987008}
I20260929 11:37:05.448405 18535 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:05.557808 18475 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:05.566985 18192 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:05.508505 18275 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:05.449635 18548 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:05.548496 17315 raft_consensus.cc:2454] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:04.835270 17459 rpcz_store.cc:276] 0929 11:37:03.684282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.773629 (+ 89347us) service_pool.cc:227] Handling call
0929 11:37:03.819173 (+ 45544us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:04.238467 (+419294us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:04.239450 (+ 983us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:04.291307 (+ 51857us) log.cc:842] Serialized 26 byte log entry
0929 11:37:04.433416 (+142109us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:04.439091 (+ 5675us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.481201 (+ 42110us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:04.802375 (+321174us) raft_consensus.cc:1671] finished
0929 11:37:04.802398 (+ 23us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:04.802558 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":51974,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":8514,"thread_start_us":431629,"threads_started":2,"wal-append.queue_time_us":254489}
I20260929 11:37:05.571365 18530 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:05.741669 18530 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:37:05.707903 18474 consensus_meta.cc:287] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a: Time spent flushing consensus metadata: real 0.586s user 0.007s sys 0.002s
I20260929 11:37:05.607698 18526 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.666538 18529 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:05.751314 18529 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
W20260929 11:37:05.647457 18452 consensus_meta.cc:287] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.857s user 0.000s sys 0.008s
I20260929 11:37:05.751955 18529 raft_consensus.cc:504] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:05.752969 17462 raft_consensus.cc:2396] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:05.754565 18529 leader_election.cc:288] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:05.755879 18464 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.698400 18299 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.699177 18444 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:05.645684 18229 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:05.626116 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:05.725178 18442 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.686s user 0.007s sys 0.003s
I20260929 11:37:05.715447 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:05.644536 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:05.720558 18457 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:05.742841 18247 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
W20260929 11:37:05.667351 18522 consensus_meta.cc:287] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 0.958s user 0.006s sys 0.005s
I20260929 11:37:05.761641 18474 raft_consensus.cc:2726] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260929 11:37:05.803534 18310 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.749s user 0.000s sys 0.026s
W20260929 11:37:05.812037 18442 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.790s user 0.008s sys 0.003s
I20260929 11:37:05.737952 18192 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:05.885811 18310 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.831s user 0.000s sys 0.026s
I20260929 11:37:05.864192 18529 raft_consensus.cc:482] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:05.889736 18519 leader_election.cc:288] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:05.808465 18299 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:05.900297 18474 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:05.760699 18526 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:05.762408 18464 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:05.867702 18247 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:05.880208 18522 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:05.909102 18574 raft_consensus.cc:2781] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260929 11:37:05.933784 18341 consensus_meta.cc:287] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 0.955s user 0.008s sys 0.002s
W20260929 11:37:05.941900 18570 log.cc:924] Time spent T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260929 11:37:05.934791 18578 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:05.940387 18574 raft_consensus.cc:482] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:05.928428 18474 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:05.962064 18192 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:05.947059 18572 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:05.949994 18580 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:05.960259 18566 log.cc:924] Time spent T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.224s user 0.001s sys 0.001s
I20260929 11:37:05.957530 18475 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:05.957227 18275 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:05.956199 18577 raft_consensus.cc:2726] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260929 11:37:05.994029 18567 log.cc:924] Time spent T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.233s user 0.000s sys 0.001s
I20260929 11:37:05.947402 18341 raft_consensus.cc:504] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:05.994323 18579 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.958936 18574 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:05.972251 18548 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.006309 18247 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.010921 18341 leader_election.cc:288] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.011691 18579 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.024164 18579 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.002991 18585 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.025889 18585 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.028537 18585 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:05.967115 18586 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:05.997761 18572 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:05.971349 18587 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:06.002095 18580 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:05.960011 18578 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.036281 18572 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.036751 18587 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.043867 18587 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.038550 18580 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:06.040380 18578 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:05.966207 18535 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.033357 18586 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:06.048259 18586 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:06.018651 18474 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:05.989886 18457 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.051541 18522 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.052910 18526 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:05.927533 18529 raft_consensus.cc:504] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:06.122555 17138 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:41970 (request call id 43) took 1880 ms. Trace:
I20260929 11:37:06.252177 17138 rpcz_store.cc:276] 0929 11:37:04.241789 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.245691 (+ 3902us) service_pool.cc:227] Handling call
0929 11:37:04.250033 (+ 4342us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0929 11:37:06.118433 (+1868400us) catalog_manager.cc:2245] Verify if the table creation is in progress for test-workload [id=c33ffac36bf0417991992a55b9f6afb6]
0929 11:37:06.122174 (+ 3741us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1867804}
I20260929 11:37:06.254920 18529 leader_election.cc:288] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:37:06.133030 17140 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41942 (request call id 57) took 13784 ms (client timeout 15000 ms). Trace:
W20260929 11:37:06.135453 17281 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.530s user 0.003s sys 0.002s
W20260929 11:37:06.136310 17283 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.542s user 0.001s sys 0.005s
W20260929 11:37:06.136837 17208 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.067s user 0.009s sys 0.009s
W20260929 11:37:06.137463 17209 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.110s user 0.016s sys 0.005s
I20260929 11:37:05.800256 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48800 (request call id 251) took 1104 ms. Trace:
F20260929 11:37:06.259145 14199 test_workload.cc:378] Timed out: Timed out waiting for Table Creation
*** Check failure stack trace: ***
I20260929 11:37:06.139881 17243 raft_consensus.cc:1261] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
*** Aborted at 1790681826 (unix time) try "date -d @1790681826" if you are using GNU date ***
I20260929 11:37:06.391579 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 248) took 2863 ms. Trace:
I20260929 11:37:06.147521 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 311) took 1026 ms. Trace:
I20260929 11:37:06.392496 17310 rpcz_store.cc:276] 0929 11:37:05.121179 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:05.275283 (+154104us) service_pool.cc:227] Handling call
0929 11:37:06.145649 (+870366us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:06.146202 (+ 553us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:06.146762 (+ 560us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:06.146817 (+ 55us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:06.146884 (+ 67us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:06.146973 (+ 89us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.147082 (+ 109us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.147243 (+ 161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27374336}
I20260929 11:37:06.394511 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.395569 17310 raft_consensus.cc:2379] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 4: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:06.149230 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.397414 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:06.398136 17316 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:06.150273 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 245) took 1859 ms. Trace:
I20260929 11:37:06.135708 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:06.400924 17234 raft_consensus.cc:3037] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:06.400496 17314 rpcz_store.cc:276] 0929 11:37:04.290804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.290974 (+ 170us) service_pool.cc:227] Handling call
0929 11:37:04.305829 (+ 14855us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:04.545107 (+239278us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.149650 (+1604543us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54000fd2d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:06.150074 (+ 424us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":447621376}
I20260929 11:37:06.402084 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.153452 17311 consensus_queue.cc:260] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.143689 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:37:06.163128 17309 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48800 (request call id 241) took 1836 ms (client timeout 1834 ms). Trace:
I20260929 11:37:06.166134 17312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 251) took 1511 ms. Trace:
I20260929 11:37:06.404511 18496 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:06.404717 17312 rpcz_store.cc:276] 0929 11:37:04.654892 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.164440 (+1509548us) service_pool.cc:227] Handling call
0929 11:37:06.165038 (+ 598us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:06.165568 (+ 530us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:06.165601 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:06.165674 (+ 73us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:06.165713 (+ 39us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.165777 (+ 64us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.165928 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:06.405457 18496 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.406170 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.407562 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.170167 17318 raft_consensus.cc:1226] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
W20260929 11:37:06.404368 17309 rpcz_store.cc:269] 0929 11:37:04.326371 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.162586 (+1836215us) service_pool.cc:214] Skipping call since client already timed out
0929 11:37:06.162873 (+ 287us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260929 11:37:06.408861 17318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48786 (request call id 250) took 1758 ms. Trace:
I20260929 11:37:06.409336 17318 rpcz_store.cc:276] 0929 11:37:04.650751 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:05.008567 (+357816us) service_pool.cc:227] Handling call
0929 11:37:06.169167 (+1160600us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:06.169558 (+ 391us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:06.408535 (+238977us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.408796 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16128384}
I20260929 11:37:06.409950 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.410578 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.411351 17318 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:06.411571 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.177657 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 285) took 3245 ms. Trace:
I20260929 11:37:06.412480 17242 rpcz_store.cc:276] 0929 11:37:02.932260 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.006729 (+ 74469us) service_pool.cc:227] Handling call
0929 11:37:03.007030 (+ 301us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:03.125653 (+118623us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:03.125692 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:03.126114 (+ 422us) log.cc:842] Serialized 26 byte log entry
0929 11:37:03.234256 (+108142us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:03.234294 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.176652 (+2942358us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540046b9d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:06.176744 (+ 92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:06.176871 (+ 127us) raft_consensus.cc:1671] finished
0929 11:37:06.176889 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.177394 (+ 505us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1463,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8379,"spinlock_wait_cycles":272076544,"thread_start_us":96766,"threads_started":1,"wal-append.queue_time_us":204744,"wal-append.run_cpu_time_us":1517,"wal-append.run_wall_time_us":1005414}
I20260929 11:37:06.413940 17234 raft_consensus.cc:2454] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:06.179771 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 270) took 2463 ms. Trace:
W20260929 11:37:06.200848 17238 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s user 0.005s sys 0.009s
W20260929 11:37:06.415063 17238 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s user 0.006s sys 0.009s
I20260929 11:37:06.416253 17238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 285) took 1656 ms. Trace:
I20260929 11:37:06.391955 17243 rpcz_store.cc:276] 0929 11:37:03.528638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.583659 (+ 55021us) service_pool.cc:227] Handling call
0929 11:37:03.680807 (+ 97148us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:06.137935 (+2457128us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934b7c 00007f79b693473b 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:06.138635 (+ 700us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:06.391239 (+252604us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.391513 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24480256}
I20260929 11:37:06.416697 17238 rpcz_store.cc:276] 0929 11:37:04.759651 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.779589 (+ 19938us) service_pool.cc:227] Handling call
0929 11:37:04.829981 (+ 50392us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:04.857608 (+ 27627us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:04.863986 (+ 6378us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:05.061763 (+197777us) log.cc:842] Serialized 26 byte log entry
0929 11:37:06.197265 (+1135502us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b694e5fe 00007f79bf785a39 00007f79b696b8bb 00007f79b6969cbf 00007f79b696be22 00007f79b95155bb
0929 11:37:06.415595 (+218330us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:06.415662 (+ 67us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.415781 (+ 119us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:06.415862 (+ 81us) raft_consensus.cc:1671] finished
0929 11:37:06.415876 (+ 14us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.416195 (+ 319us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3226,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"spinlock_wait_cycles":110533376,"thread_start_us":1062612,"threads_started":1,"wal-append.queue_time_us":952896}
W20260929 11:37:06.207329 17358 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.959s user 0.001s sys 0.010s
W20260929 11:37:06.418540 17234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 268) took 2711 ms (client timeout 2249 ms). Trace:
W20260929 11:37:06.418924 17358 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.188s user 0.001s sys 0.010s
I20260929 11:37:06.414875 17241 rpcz_store.cc:276] 0929 11:37:03.716057 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.133130 (+417073us) service_pool.cc:227] Handling call
0929 11:37:04.746281 (+613151us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:04.785236 (+ 38955us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.179219 (+1393983us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54004605d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:06.179530 (+ 311us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1386424704}
I20260929 11:37:05.860888 17383 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
W20260929 11:37:06.209842 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 243) took 1669 ms (client timeout 1866 ms). Trace:
I20260929 11:37:06.422526 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.423135 18131 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.423609 17310 raft_consensus.cc:2454] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
W20260929 11:37:06.421061 18552 log.cc:924] Time spent T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 1.815s user 0.015s sys 0.032s
I20260929 11:37:06.423823 18131 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.425064 18342 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.420652 17312 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:06.407951 18496 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:06.425860 18342 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:06.421007 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:06.426399 18131 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.427042 17318 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:06.422353 17388 rpcz_store.cc:269] 0929 11:37:04.539832 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:05.572147 (+1032315us) service_pool.cc:227] Handling call
0929 11:37:06.209456 (+637309us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:06.428828 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:06.429915 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 202) took 1625 ms (client timeout 1713 ms). Trace:
W20260929 11:37:06.430428 17388 rpcz_store.cc:269] 0929 11:37:04.804713 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.428402 (+1623689us) service_pool.cc:227] Handling call
0929 11:37:06.429815 (+ 1413us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:05.729112 17356 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.620s user 0.000s sys 0.009s
I20260929 11:37:06.432116 17206 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:06.432411 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.433657 17388 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
W20260929 11:37:06.434571 17388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 238) took 2008 ms (client timeout 2177 ms). Trace:
W20260929 11:37:06.210976 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 240) took 1783 ms (client timeout 2060 ms). Trace:
I20260929 11:37:06.212301 17392 raft_consensus.cc:2354] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 4. Current term is 5.
W20260929 11:37:06.435811 17383 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 201) took 1631 ms (client timeout 1501 ms). Trace:
W20260929 11:37:06.214603 17386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 223) took 3859 ms (client timeout 1536 ms). Trace:
W20260929 11:37:06.216085 17385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 240) took 4407 ms (client timeout 3145 ms). Trace:
W20260929 11:37:06.217998 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 193) took 1419 ms (client timeout 1533 ms). Trace:
W20260929 11:37:06.435372 17391 rpcz_store.cc:269] 0929 11:37:04.426893 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:05.605667 (+1178774us) service_pool.cc:227] Handling call
0929 11:37:06.210702 (+605035us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:06.441279 17389 rpcz_store.cc:269] 0929 11:37:04.798246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:05.326885 (+528639us) service_pool.cc:227] Handling call
0929 11:37:06.217456 (+890571us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54004317d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:06.217778 (+ 322us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":91924352}
I20260929 11:37:06.442035 17311 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.442193 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.442611 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:37:06.443284 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 200) took 1639 ms (client timeout 1943 ms). Trace:
I20260929 11:37:06.225286 17458 raft_consensus.cc:1226] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:06.233753 18299 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.086207 18574 raft_consensus.cc:504] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:06.444523 17458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 321) took 4024 ms. Trace:
W20260929 11:37:06.258148 17283 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.664s user 0.002s sys 0.005s
I20260929 11:37:06.445073 17458 rpcz_store.cc:276] 0929 11:37:02.419597 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.477009 (+1057412us) service_pool.cc:227] Handling call
0929 11:37:03.477491 (+ 482us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:06.224774 (+2747283us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b5400197e20. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9824730 00007f79b9896300 00007f79b9897371 00007f79b9893edf 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc
0929 11:37:06.444048 (+219274us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.444424 (+ 376us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":22668672}
I20260929 11:37:06.446692 18574 leader_election.cc:288] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:06.257748 17281 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.695s user 0.003s sys 0.003s
W20260929 11:37:06.258682 17208 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.189s user 0.010s sys 0.009s
W20260929 11:37:06.138463 17284 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.583s user 0.003s sys 0.010s
W20260929 11:37:06.448988 17284 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.894s user 0.003s sys 0.010s
I20260929 11:37:06.260456 18585 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:37:06.450611 17208 connection.cc:232] RPC call timeout handler was delayed by -1.3591337450002356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27730000000000005s for a response
I20260929 11:37:06.450824 18585 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:37:06.451735 17208 connection.cc:232] RPC call timeout handler was delayed by -1.1502796740001031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260929 11:37:06.452674 18365 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:06.453157 18585 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.236913 18578 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:06.453325 18365 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:06.454545 17318 raft_consensus.cc:2454] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:06.244247 18586 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:06.455442 18586 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.456205 18426 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:06.456938 18285 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:06.456869 18426 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.457751 18586 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.246645 18587 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:06.457674 18285 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:06.458590 18587 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.459107 18426 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.460690 18587 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.266861 18346 raft_consensus.cc:3037] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:06.461443 18476 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.462087 17311 raft_consensus.cc:1261] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260929 11:37:06.462550 17311 pending_rounds.cc:76] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: Aborting all ops after (but not including) 1
I20260929 11:37:06.462217 18476 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.462819 17311 pending_rounds.cc:97] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260929 11:37:06.463178 17311 raft_consensus.cc:2866] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260929 11:37:06.257531 17140 rpcz_store.cc:269] 0929 11:36:52.348272 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:36:52.348455 (+ 183us) service_pool.cc:227] Handling call
0929 11:37:06.132711 (+13784256us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0929 11:37:01.574596 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0929 11:37:01.575176 (+ 580us) write_op.cc:432] Acquiring schema lock in shared mode
0929 11:37:01.575220 (+ 44us) write_op.cc:435] Acquired schema lock
0929 11:37:01.575236 (+ 16us) tablet.cc:660] Decoding operations
0929 11:37:01.575596 (+ 360us) write_op.cc:620] Acquiring the partition lock for write op
0929 11:37:01.575658 (+ 62us) write_op.cc:641] Partition lock acquired for write op
0929 11:37:01.575699 (+ 41us) tablet.cc:683] Acquiring locks for 1 operations
0929 11:37:01.575905 (+ 206us) tablet.cc:699] Row locks acquired
0929 11:37:01.575921 (+ 16us) write_op.cc:260] PREPARE: finished
0929 11:37:01.576072 (+ 151us) write_op.cc:270] Start()
0929 11:37:01.576188 (+ 116us) write_op.cc:276] Timestamp: P: 1790681821576027 usec, L: 0
0929 11:37:01.576208 (+ 20us) op_driver.cc:331] REPLICATION: starting
0929 11:37:01.576888 (+ 680us) log.cc:842] Serialized 543 byte log entry
0929 11:37:01.904515 (+327627us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b694e5fe 00007f79bf785a39 00007f79b696b8bb 00007f79b6969cbf 00007f79b696be22 00007f79b95155bb
0929 11:37:02.449648 (+545133us) op_driver.cc:444] REPLICATION: finished
0929 11:37:02.694071 (+244423us) write_op.cc:301] APPLY: starting
0929 11:37:02.702529 (+ 8458us) tablet.cc:1365] starting BulkCheckPresence
0929 11:37:02.726176 (+ 23647us) tablet.cc:1368] finished BulkCheckPresence
0929 11:37:02.726200 (+ 24us) tablet.cc:1370] starting ApplyRowOperation cycle
0929 11:37:02.744391 (+ 18191us) tablet.cc:1381] finished ApplyRowOperation cycle
0929 11:37:02.744562 (+ 171us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0929 11:37:02.744603 (+ 41us) write_op.cc:312] APPLY: finished
0929 11:37:02.768073 (+ 23470us) log.cc:842] Serialized 22 byte log entry
0929 11:37:02.775941 (+ 7868us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:37:02.776023 (+ 82us) write_op.cc:454] Released schema lock
0929 11:37:02.776062 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0929 11:37:02.776360 (+ 298us) write_op.cc:489] Releasing partition, row and schema locks
0929 11:37:02.776394 (+ 34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":422354,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":211031,"apply.run_cpu_time_us":2531,"apply.run_wall_time_us":94201,"num_ops":1,"prepare.queue_time_us":224259,"prepare.run_cpu_time_us":75969,"prepare.run_wall_time_us":468613,"raft.queue_time_us":247075,"raft.run_cpu_time_us":2626,"raft.run_wall_time_us":64943,"replication_time_us":843261,"spinlock_wait_cycles":37022464,"thread_start_us":706617,"threads_started":4,"wal-append.queue_time_us":575839,"wal-append.run_cpu_time_us":54365,"wal-append.run_wall_time_us":1626184}]]}
W20260929 11:37:06.269255 18593 log.cc:924] Time spent T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.065s user 0.000s sys 0.001s
I20260929 11:37:06.460073 18285 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:37:06.264477 17240 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s user 0.000s sys 0.033s
W20260929 11:37:06.270587 17207 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.645s user 0.006s sys 0.033s
I20260929 11:37:06.280985 18373 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:06.292459 18537 raft_consensus.cc:3032] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
W20260929 11:37:06.302225 18565 log.cc:924] Time spent T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 1.193s user 0.023s sys 0.032s
I20260929 11:37:06.309031 18016 raft_consensus.cc:3032] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
W20260929 11:37:06.314981 18524 log.cc:924] Time spent T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 2.435s user 0.037s sys 0.050s
I20260929 11:37:06.317615 18501 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:37:06.317736 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:37:06.325734 18464 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.326740 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.326939 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:06.329692 18487 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:06.330438 18463 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:06.337663 17429 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:06.327958 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:37:06.344277 17357 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59212 dropped due to backpressure. The service queue is full; it has 50 items.
I20260929 11:37:06.355386 18525 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:06.355345 18240 consensus_queue.cc:1035] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:06.356508 18181 consensus_queue.cc:1035] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:37:06.360437 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56174 (request call id 352) took 1707 ms. Trace:
I20260929 11:37:06.376246 18473 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:06.374866 17355 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59212 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 198)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 262)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 255)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 184)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 187)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 188)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 189)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 190)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 246)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 194)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 199)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 267)
W20260929 11:37:06.381608 18568 log.cc:924] Time spent T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.570s user 0.000s sys 0.016s
I20260929 11:37:06.382310 18507 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:06.402817 17314 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:06.418264 17461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32868 (request call id 230) took 2740 ms. Trace:
W20260929 11:37:06.210229 17387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 185) took 3276 ms (client timeout 2030 ms). Trace:
W20260929 11:37:06.212992 17384 consensus_meta.cc:287] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 1.513s user 0.008s sys 0.008s
I20260929 11:37:06.488587 18501 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:06.488897 17384 raft_consensus.cc:2454] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
W20260929 11:37:06.489751 17384 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 239) took 2063 ms (client timeout 1684 ms). Trace:
I20260929 11:37:06.489405 18501 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:37:06.490239 17384 rpcz_store.cc:269] 0929 11:37:04.426620 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.699076 (+272456us) service_pool.cc:227] Handling call
0929 11:37:06.489644 (+1790568us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:06.436615 17388 rpcz_store.cc:269] 0929 11:37:04.426340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.431816 (+2005476us) service_pool.cc:227] Handling call
0929 11:37:06.434480 (+ 2664us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:06.439138 18509 raft_consensus.cc:2781] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:06.491922 18509 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260929 11:37:06.443737 17391 rpcz_store.cc:269] 0929 11:37:04.804130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.441771 (+1637641us) service_pool.cc:227] Handling call
0929 11:37:06.443209 (+ 1438us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:06.492415 18509 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:06.486945 17387 rpcz_store.cc:269] 0929 11:37:02.934095 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.035603 (+101508us) service_pool.cc:227] Handling call
0929 11:37:06.209699 (+3174096us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b5400399754. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:06.209984 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":75645824}
W20260929 11:37:06.492939 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 155726us
I20260929 11:37:06.493743 18464 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:06.494206 18464 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:06.494575 18464 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
W20260929 11:37:06.440745 17356 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.323s user 0.000s sys 0.009s
I20260929 11:37:06.478273 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:37:06.441078 17386 rpcz_store.cc:269] 0929 11:37:02.358015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.438174 (+ 80159us) service_pool.cc:227] Handling call
0929 11:37:06.214144 (+3775970us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54004ac254. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:06.214423 (+ 279us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1281692928}
W20260929 11:37:06.259049 17209 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.232s user 0.017s sys 0.005s
I20260929 11:37:06.259564 17315 rpcz_store.cc:276] 0929 11:37:04.654182 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.707681 (+ 53499us) service_pool.cc:227] Handling call
0929 11:37:05.743187 (+1035506us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:06.499873 17460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 351) took 1885 ms. Trace:
I20260929 11:37:06.501559 18285 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.261680 18348 raft_consensus.cc:3032] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:06.502192 18348 raft_consensus.cc:729] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:06.502326 18285 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.502933 18549 raft_consensus.cc:482] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.503588 18549 raft_consensus.cc:504] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:06.461815 17208 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:06.464015 18342 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.454180 18578 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.503495 18348 consensus_queue.cc:260] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.455633 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.465040 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:06.455686 18365 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.507366 17312 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 5
I20260929 11:37:06.507793 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:06.507982 18348 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:06.466827 18537 raft_consensus.cc:729] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:06.468449 18016 raft_consensus.cc:729] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:06.508947 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.509995 17238 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 5: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:06.510147 18537 consensus_queue.cc:260] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.510222 18016 consensus_queue.cc:260] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.511085 18574 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:06.511586 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 49982.5us
I20260929 11:37:06.477346 17457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 348) took 2021 ms. Trace:
I20260929 11:37:06.511951 18574 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:06.476060 18487 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.513430 18581 raft_consensus.cc:2726] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:06.512521 17457 rpcz_store.cc:276] 0929 11:37:04.456296 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.686971 (+230675us) service_pool.cc:227] Handling call
0929 11:37:04.687427 (+ 456us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:04.687896 (+ 469us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:04.687938 (+ 42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:04.688541 (+ 603us) log.cc:842] Serialized 26 byte log entry
0929 11:37:04.933295 (+244754us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:04.964972 (+ 31677us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:04.984965 (+ 19993us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:06.300982 (+1316017us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b9516bee 00007f79b9515f36 00007f79b9515b58 00007f79b951f551 00007f79b951f509 00007f79b951f499
0929 11:37:06.476737 (+175755us) raft_consensus.cc:1671] finished
0929 11:37:06.476767 (+ 30us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.477113 (+ 346us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1387,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":120306944,"thread_start_us":175094,"threads_started":1,"wal-append.queue_time_us":371883}
I20260929 11:37:06.504534 18080 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.514210 18581 consensus_queue.cc:1035] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:06.514899 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:06.515369 17241 raft_consensus.cc:1261] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260929 11:37:06.465994 17240 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.852s user 0.000s sys 0.034s
I20260929 11:37:06.516719 18285 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.517799 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 280) took 2084 ms. Trace:
W20260929 11:37:06.467119 17385 rpcz_store.cc:269] 0929 11:37:01.808948 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:01.832494 (+ 23546us) service_pool.cc:227] Handling call
0929 11:37:06.215581 (+4383087us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54004c9fd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:06.215855 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2572568448}
W20260929 11:37:06.466578 17207 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.862s user 0.007s sys 0.033s
I20260929 11:37:06.519788 18578 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.475667 17466 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
W20260929 11:37:06.520776 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 952507us
I20260929 11:37:06.521137 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.512523 18507 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.522535 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.466392 17313 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 310) took 1480 ms. Trace:
I20260929 11:37:06.508565 17242 raft_consensus.cc:3037] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:06.478937 17462 rpcz_store.cc:276] 0929 11:37:04.652771 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.677353 (+ 24582us) service_pool.cc:227] Handling call
0929 11:37:06.359916 (+1682563us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540034dd54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:06.360219 (+ 303us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2431941888}
I20260929 11:37:06.526877 17237 raft_consensus.cc:1226] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:06.527782 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.528416 17462 raft_consensus.cc:2454] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:06.476920 17357 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59212 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 198)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 262)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 255)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 184)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 187)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 188)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 189)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 190)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 246)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 194)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 199)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 267)
I20260929 11:37:06.466691 18373 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.530059 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.529220 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.531857 17462 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:06.491933 17464 raft_consensus.cc:2396] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260929 11:37:06.533104 18275 consensus_queue.cc:1046] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:37:06.533486 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.534142 17238 raft_consensus.cc:1261] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:06.523229 17313 rpcz_store.cc:276] 0929 11:37:04.985629 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.167238 (+1181609us) service_pool.cc:227] Handling call
0929 11:37:06.183285 (+ 16047us) raft_consensus.cc:1457] Updating replica for 2 ops
0929 11:37:06.184184 (+ 899us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:06.184222 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0929 11:37:06.185204 (+ 982us) log.cc:842] Serialized 52 byte log entry
0929 11:37:06.205272 (+ 20068us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:06.205321 (+ 49us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.205426 (+ 105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:06.466044 (+260618us) raft_consensus.cc:1671] finished
0929 11:37:06.466065 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.466209 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7848,"raft.queue_time_us":47383,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":6583,"thread_start_us":19509,"threads_started":1,"wal-append.queue_time_us":18286}
I20260929 11:37:06.485426 17461 rpcz_store.cc:276] 0929 11:37:03.679003 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.773688 (+ 94685us) service_pool.cc:227] Handling call
0929 11:37:03.876610 (+102922us) raft_consensus.cc:1457] Updating replica for 2 ops
0929 11:37:04.053769 (+177159us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:04.060479 (+ 6710us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0929 11:37:04.061106 (+ 627us) log.cc:842] Serialized 52 byte log entry
0929 11:37:06.270977 (+2209871us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b180042f640. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b694e345 00007f79bf785a39 00007f79b696b8bb 00007f79b6969cbf 00007f79b696be22 00007f79b95155bb 00007f79b951b063 00007f79b951b411 00007f79b98685cf
0929 11:37:06.300131 (+ 29154us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:06.300248 (+ 117us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.417672 (+117424us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54005749d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:06.417742 (+ 70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:06.417807 (+ 65us) raft_consensus.cc:1671] finished
0929 11:37:06.417828 (+ 21us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.418057 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":7940,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8864,"spinlock_wait_cycles":331134464,"thread_start_us":28517,"threads_started":1,"wal-append.queue_time_us":2247577}
I20260929 11:37:06.446712 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.536397 18439 consensus_queue.cc:1046] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:06.536772 17458 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 1.
I20260929 11:37:06.538008 18449 raft_consensus.cc:3032] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:06.538365 18449 raft_consensus.cc:729] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:06.523777 17239 raft_consensus.cc:1226] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:06.540134 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.514137 18487 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.540812 18449 consensus_queue.cc:260] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.514907 18080 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.542315 18449 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.542672 18549 leader_election.cc:288] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.525347 17243 raft_consensus.cc:1261] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:06.483487 17206 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:06.500260 17460 rpcz_store.cc:276] 0929 11:37:04.614446 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.754790 (+140344us) service_pool.cc:227] Handling call
0929 11:37:04.755118 (+ 328us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:04.755951 (+ 833us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:04.755990 (+ 39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:04.756511 (+ 521us) log.cc:842] Serialized 26 byte log entry
0929 11:37:05.046354 (+289843us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:05.051580 (+ 5226us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:05.108547 (+ 56967us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:06.380505 (+1271958us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b44000232cc. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b687ea95 00007f79b687f4b2 00007f79b9527511 00007f79b9522e1a 00007f79b9516bee 00007f79b9515f36 00007f79b9515b58 00007f79b951f551 00007f79b951f509 00007f79b951f499
0929 11:37:06.499356 (+118851us) raft_consensus.cc:1671] finished
0929 11:37:06.499382 (+ 26us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.499652 (+ 270us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":305,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":85,"spinlock_wait_cycles":76309888,"thread_start_us":274050,"threads_started":1,"wal-append.queue_time_us":975732}
W20260929 11:37:06.460842 17392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 244) took 1815 ms (client timeout 1582 ms). Trace:
I20260929 11:37:06.532869 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:37:06.464406 17383 rpcz_store.cc:269] 0929 11:37:04.804443 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:05.053548 (+249105us) service_pool.cc:227] Handling call
0929 11:37:06.435545 (+1381997us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:06.475796 18027 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:06.268443 17317 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s user 0.007s sys 0.015s
I20260929 11:37:06.465404 18476 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:06.504594 18530 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.443641 17389 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:06.508136 18463 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.525331 18506 raft_consensus.cc:2726] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:06.534236 18275 raft_consensus.cc:3032] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Stepping down as leader of term 4
W20260929 11:37:06.498039 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 1.38891e+06us
I20260929 11:37:06.531442 17357 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59212 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 198)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 276)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 262)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 275)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 263)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 279)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 255)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 184)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 187)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 188)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 189)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 190)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 235)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 259)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 246)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 194)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 195)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 199)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 267)
I20260929 11:37:06.464265 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 240) took 2139 ms. Trace:
I20260929 11:37:06.511739 18537 raft_consensus.cc:3037] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:06.496785 18501 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:06.544293 17392 rpcz_store.cc:269] 0929 11:37:04.645515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:05.028793 (+383278us) service_pool.cc:227] Handling call
0929 11:37:06.460604 (+1431811us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54003de5d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:06.460772 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1972088064}
W20260929 11:37:06.544231 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 52979.5us
W20260929 11:37:06.419554 17234 rpcz_store.cc:269] 0929 11:37:03.703405 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:03.865448 (+162043us) service_pool.cc:227] Handling call
0929 11:37:06.135225 (+2269777us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:06.414597 (+279372us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10893184}
I20260929 11:37:06.567081 17462 raft_consensus.cc:2454] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
W20260929 11:37:06.556598 17389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 247) took 1758 ms (client timeout 1959 ms). Trace:
W20260929 11:37:06.558315 17317 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s user 0.008s sys 0.016s
W20260929 11:37:06.567852 17389 rpcz_store.cc:269] 0929 11:37:04.792282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.442294 (+1650012us) service_pool.cc:227] Handling call
0929 11:37:06.550917 (+108623us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:06.558408 18530 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.559301 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:06.578498 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.579167 17383 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:06.580272 17390 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:06.581051 18355 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.581624 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.581518 18355 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.582365 17236 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:06.583284 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.559986 18027 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.561964 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.586391 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.587414 17237 raft_consensus.cc:2396] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260929 11:37:06.523821 18507 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
W20260929 11:37:06.587512 18197 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260929 11:37:06.589758 17314 raft_consensus.cc:1226] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:06.590973 17314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.591552 17314 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:06.564472 18463 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.556668 18275 raft_consensus.cc:729] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:06.592886 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.593037 18275 consensus_queue.cc:260] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.594462 18275 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:06.572788 17431 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:06.518152 17240 rpcz_store.cc:276] 0929 11:37:04.433856 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.760112 (+326256us) service_pool.cc:227] Handling call
0929 11:37:04.760512 (+ 400us) raft_consensus.cc:1457] Updating replica for 2 ops
0929 11:37:04.760973 (+ 461us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:04.761013 (+ 40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0929 11:37:04.786666 (+ 25653us) log.cc:842] Serialized 52 byte log entry
0929 11:37:05.559543 (+772877us) raft_consensus.cc:1631] Marking committed up to 3
0929 11:37:06.516621 (+957078us) log.cc:842] Serialized 14 byte log entry
0929 11:37:06.517180 (+ 559us) log.cc:842] Serialized 14 byte log entry
0929 11:37:06.517413 (+ 233us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.517513 (+ 100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:06.517573 (+ 60us) raft_consensus.cc:1671] finished
0929 11:37:06.517585 (+ 12us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.517743 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":448468,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":997,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":5070,"thread_start_us":1669751,"threads_started":2,"wal-append.queue_time_us":879843}
I20260929 11:37:06.596922 18443 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:06.597086 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.597424 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.597774 17240 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:06.597579 18443 raft_consensus.cc:504] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.598708 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.497025 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.599305 17240 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:06.512035 18016 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.599601 17309 raft_consensus.cc:2454] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 1.
I20260929 11:37:06.550956 18080 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.573668 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.575026 17239 raft_consensus.cc:1226] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:06.601292 17318 raft_consensus.cc:2454] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:06.576018 17283 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:06.600176 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.576911 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.584851 17317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 306) took 1945 ms. Trace:
I20260929 11:37:06.555753 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.612692 18464 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:06.615167 18464 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.609282 17317 rpcz_store.cc:276] 0929 11:37:04.639452 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.966253 (+326801us) service_pool.cc:227] Handling call
0929 11:37:05.568241 (+601988us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:05.568476 (+ 235us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:05.734118 (+165642us) log.cc:842] Serialized 14 byte log entry
0929 11:37:06.584373 (+850255us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:06.584464 (+ 91us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:06.584532 (+ 68us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.584635 (+ 103us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:06.584797 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":244562,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":1614,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":104,"thread_start_us":849754,"threads_started":1,"wal-append.queue_time_us":511178}
I20260929 11:37:06.616580 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8d7cf3a0d84804ad52464db2fb53ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:06.616497 18373 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.617424 17239 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:06.514169 18574 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:06.593639 17313 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
W20260929 11:37:06.601029 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 132713us
I20260929 11:37:06.574337 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.581545 17429 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:06.580089 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.610281 17312 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:06.612869 17458 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:06.613059 18525 raft_consensus.cc:2781] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:06.620783 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.548262 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:06.621820 17314 raft_consensus.cc:1226] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:06.551676 17316 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 5.
W20260929 11:37:06.626340 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 44875.7us
I20260929 11:37:06.628027 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:06.621898 17242 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:06.629449 18197 raft_consensus.cc:3037] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:06.628100 18464 raft_consensus.cc:2781] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:06.628947 17241 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:06.632606 17460 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:06.652284 18464 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:06.652144 17429 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:06.652866 18464 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.653751 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:06.654778 17460 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.649554 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.657490 17243 raft_consensus.cc:2379] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 2: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:06.660477 17235 raft_consensus.cc:2379] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:06.662849 17460 raft_consensus.cc:2454] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:06.642860 18525 raft_consensus.cc:686] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:06.665536 18525 consensus_queue.cc:237] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:06.617965 18342 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.667973 18342 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:06.671120 18342 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:06.674177 17383 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:06.675618 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.676803 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.677740 17388 raft_consensus.cc:2454] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:06.678362 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 196) took 1879 ms. Trace:
I20260929 11:37:06.678748 17388 rpcz_store.cc:276] 0929 11:37:04.799051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.676384 (+1877333us) service_pool.cc:227] Handling call
0929 11:37:06.678295 (+ 1911us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:06.680452 17236 raft_consensus.cc:3037] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:06.682647 18355 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.640945 18080 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.685328 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.686534 17392 raft_consensus.cc:2379] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:06.687726 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:06.633311 17459 raft_consensus.cc:2454] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
W20260929 11:37:06.634191 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 58304.6us
I20260929 11:37:06.596101 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.635263 17356 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:06.599601 18443 leader_election.cc:288] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.618275 18463 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.558111 17311 rpcz_store.cc:276] 0929 11:37:04.324906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.752306 (+427400us) service_pool.cc:227] Handling call
0929 11:37:04.752665 (+ 359us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:06.152006 (+1399341us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400251d20. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b982a951 00007f79b988b321 00007f79b988cb4e 00007f79b9896c89 00007f79b9897556 00007f79b9893edf 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612
0929 11:37:06.437934 (+285928us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b58000248b0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b980ff63 00007f79b9873aba 00007f79b988b3af 00007f79b988cb4e 00007f79b9896c89 00007f79b9897556 00007f79b9893edf 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684
0929 11:37:06.463983 (+ 26049us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.464213 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":565186176}
W20260929 11:37:06.678762 17390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 227) took 4315 ms (client timeout 2207 ms). Trace:
I20260929 11:37:06.706063 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.638922 17240 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:06.707580 17206 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:06.707881 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.709515 17389 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
W20260929 11:37:06.706449 17390 rpcz_store.cc:269] 0929 11:37:02.363533 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:02.730709 (+367176us) service_pool.cc:227] Handling call
0929 11:37:06.678523 (+3947814us) spinlock_profiling.cc:243] Waited 3.83 s on lock 0x7b540054b354. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:06.678683 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8818778368}
I20260929 11:37:06.680018 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.715731 17392 raft_consensus.cc:2362] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2. Re-sending same reply.
W20260929 11:37:06.718822 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 66840.8us
I20260929 11:37:06.719810 17429 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:06.708890 17283 leader_election.cc:302] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:06.723517 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.722911 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.684798 18080 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:06.716331 17383 raft_consensus.cc:2454] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:06.734402 17390 raft_consensus.cc:2454] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:06.731813 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:06.737015 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 93742.6us
I20260929 11:37:06.704193 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.734277 18586 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:06.743459 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.744390 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.747887 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.739877 18579 raft_consensus.cc:2726] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:06.747654 17389 raft_consensus.cc:2454] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:06.751653 17240 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
W20260929 11:37:06.752341 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 117179us
I20260929 11:37:06.753769 17390 raft_consensus.cc:2379] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:06.723491 18549 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.730783 18443 raft_consensus.cc:2726] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:06.757584 17392 raft_consensus.cc:2454] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:06.748342 18574 raft_consensus.cc:2781] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:06.750921 18585 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:06.763736 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:06.748688 18586 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:06.767048 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.767020 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.768072 17356 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:06.768453 17242 raft_consensus.cc:2454] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:06.765058 18027 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:06.770224 18487 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:06.770910 18487 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:06.774097 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:06.778663 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:06.779472 17389 raft_consensus.cc:2362] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4. Re-sending same reply.
I20260929 11:37:06.779657 17236 raft_consensus.cc:2454] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:06.753600 17388 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:06.773105 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:06.784729 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 83123.1us
I20260929 11:37:06.785851 18342 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:06.784507 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.786417 18342 raft_consensus.cc:482] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:06.786798 18342 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.787237 18080 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.787730 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.789291 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:06.789952 17383 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:06.791587 18197 raft_consensus.cc:2726] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:06.792987 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.794298 18487 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:06.794492 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:06.795792 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.796586 17356 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:06.798192 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.798959 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.773370 18586 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
PC: @ 0x0 (unknown)
I20260929 11:37:06.796783 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:37:06.803692 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 75364.6us
I20260929 11:37:07.683079 17282 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:06.838481 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:07.684854 18611 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:07.685166 17243 raft_consensus.cc:2354] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4.
I20260929 11:37:07.685468 18611 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.902855 17239 raft_consensus.cc:2454] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:07.686489 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47682 (request call id 305) took 1086 ms. Trace:
I20260929 11:37:07.686781 17239 rpcz_store.cc:276] 0929 11:37:06.599706 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.609923 (+ 10217us) service_pool.cc:227] Handling call
0929 11:37:07.686395 (+1076472us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:06.913276 18601 log.cc:924] Time spent T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260929 11:37:06.829717 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:06.852178 17356 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
W20260929 11:37:07.714792 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 876533us
*** SIGABRT (@0x3e800003777) received by PID 14199 (TID 0x7f79b259e880) from PID 14199; stack trace: ***
@ 0x29bbc0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x29e2b0 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
@ 0x7f79b9c99980 (unknown) at ??:0
W20260929 11:37:06.901998 17357 connection.cc:232] RPC call timeout handler was delayed by -1.350305242000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260929 11:37:07.799690 17357 connection.cc:232] RPC call timeout handler was delayed by -1.3323052420000749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260929 11:37:07.800045 17357 connection.cc:232] RPC call timeout handler was delayed by -1.2351052420001452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260929 11:37:07.800348 17357 connection.cc:232] RPC call timeout handler was delayed by -1.1667052420000346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260929 11:37:07.800606 17357 connection.cc:232] RPC call timeout handler was delayed by -1.1397052420002183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
W20260929 11:37:07.800859 17357 connection.cc:232] RPC call timeout handler was delayed by -1.0686052420001033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260929 11:37:07.801102 17357 connection.cc:232] RPC call timeout handler was delayed by -1.0065052420000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260929 11:37:06.801471 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:07.803865 17385 raft_consensus.cc:2362] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4. Re-sending same reply.
W20260929 11:37:07.804435 17385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 206) took 1585 ms (client timeout 2106 ms). Trace:
W20260929 11:37:07.804775 17385 rpcz_store.cc:269] 0929 11:37:06.218876 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.764091 (+545215us) service_pool.cc:227] Handling call
0929 11:37:07.804369 (+1040278us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.805917 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.807140 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0779c5ab5f4982ac77456eafc8a9e7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:06.826287 17388 raft_consensus.cc:2454] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:07.809944 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 270) took 1468 ms. Trace:
I20260929 11:37:07.810286 17388 rpcz_store.cc:276] 0929 11:37:06.341815 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.795530 (+453715us) service_pool.cc:227] Handling call
0929 11:37:07.809886 (+1014356us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.811241 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.811964 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 253) took 1228 ms. Trace:
I20260929 11:37:06.800532 17389 raft_consensus.cc:2379] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:06.828869 17390 raft_consensus.cc:2454] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:07.814697 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 272) took 1472 ms. Trace:
I20260929 11:37:07.815040 17390 rpcz_store.cc:276] 0929 11:37:06.342805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.797929 (+455124us) service_pool.cc:227] Handling call
0929 11:37:07.814643 (+1016714us) inbound_call.cc:173] Queueing success response
Metrics: {}
@ 0x7f79b328ee87 gsignal at ??:0
I20260929 11:37:06.803915 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.872026 17383 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:07.018700 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.821978 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 281) took 1181 ms. Trace:
I20260929 11:37:07.822391 17383 rpcz_store.cc:276] 0929 11:37:06.640947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.789012 (+148065us) service_pool.cc:227] Handling call
0929 11:37:07.821915 (+1032903us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.823383 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:07.823982 17383 raft_consensus.cc:3037] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:07.037930 17238 raft_consensus.cc:1226] T 7e3002f11c7a4c27b73e9842ce11ee63 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
W20260929 11:37:07.098516 17208 leader_election.cc:334] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 1.838s (SENT)
I20260929 11:37:07.824653 17208 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:07.824826 17238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 295) took 1250 ms. Trace:
W20260929 11:37:07.825769 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 727225us
W20260929 11:37:07.826977 17208 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59212 dropped due to backpressure. The service queue is full; it has 50 items. [suppressed 30 similar messages]
I20260929 11:37:07.109143 17309 raft_consensus.cc:1261] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260929 11:37:07.827143 17140 catalog_manager.cc:5495] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260929 11:37:07.828130 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 322) took 1003 ms. Trace:
I20260929 11:37:07.828502 17309 rpcz_store.cc:276] 0929 11:37:06.824266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.835155 (+ 10889us) service_pool.cc:227] Handling call
0929 11:37:06.855231 (+ 20076us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:07.827836 (+972605us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:07.828075 (+ 239us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.829267 17140 catalog_manager.cc:5495] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 2, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 2 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } }
I20260929 11:37:07.117072 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:07.831034 17140 catalog_manager.cc:5495] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 0 to 3, leader changed from <none> to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 3 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } }
I20260929 11:37:07.117726 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.832573 17391 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
W20260929 11:37:07.833073 17391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 213) took 1459 ms (client timeout 1501 ms). Trace:
I20260929 11:37:07.832960 17140 catalog_manager.cc:5495] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 2, leader changed from bb8e3505668b40219823840c0d8bc3af (127.13.221.195) to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } }
W20260929 11:37:07.833492 17391 rpcz_store.cc:269] 0929 11:37:06.374049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.117423 (+743374us) service_pool.cc:227] Handling call
0929 11:37:07.833014 (+715591us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.117089 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.834527 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.835384 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 266) took 1495 ms. Trace:
I20260929 11:37:07.835685 17391 rpcz_store.cc:276] 0929 11:37:06.339725 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.834231 (+1494506us) service_pool.cc:227] Handling call
0929 11:37:07.835314 (+ 1083us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.836024 17234 raft_consensus.cc:2354] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5.
I20260929 11:37:06.857551 17431 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:06.890987 17466 raft_consensus.cc:2454] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:07.836660 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:06.901865 18016 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:06.905241 18299 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:07.843138 18016 raft_consensus.cc:504] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:07.844012 18299 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:07.844939 17466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56190 (request call id 271) took 1500 ms (client timeout 1864 ms). Trace:
W20260929 11:37:07.845316 17466 rpcz_store.cc:269] 0929 11:37:06.345419 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.522252 (+176833us) service_pool.cc:227] Handling call
0929 11:37:07.844756 (+1322504us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b540034ec54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:07.844881 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":845783808}
I20260929 11:37:07.845937 18299 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.825114 18355 raft_consensus.cc:2781] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election won for term 4
W20260929 11:37:07.848189 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 46100.5us
I20260929 11:37:07.849128 18355 raft_consensus.cc:686] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 4 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:06.883934 18342 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:07.853847 18342 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:06.807824 18373 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:07.850262 18355 consensus_queue.cc:237] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:06.863090 18443 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:06.900664 18448 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:06.870977 18452 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:07.861119 18448 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:06.902997 18463 raft_consensus.cc:2726] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:06.872925 18464 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:07.871762 17357 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:07.872812 18464 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:07.164402 18506 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:07.861867 18452 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:07.875689 17464 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:06.783361 18530 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.780520 18549 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:06.830380 18555 consensus_queue.cc:1046] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:07.880879 18549 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:06.776100 18574 raft_consensus.cc:686] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [term 2 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:07.889339 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56190 (request call id 278) took 1389 ms. Trace:
I20260929 11:37:07.889652 18452 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:07.889787 17464 rpcz_store.cc:276] 0929 11:37:06.499432 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.533180 (+ 33748us) service_pool.cc:227] Handling call
0929 11:37:07.889144 (+1355964us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54005758d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:07.889280 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3085226752}
I20260929 11:37:06.808874 17283 leader_election.cc:302] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:07.889416 18574 consensus_queue.cc:237] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:06.767151 18585 raft_consensus.cc:482] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:06.939296 18586 raft_consensus.cc:504] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:07.899775 18586 leader_election.cc:288] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:07.644835 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47682 (request call id 313) took 1029 ms. Trace:
I20260929 11:37:07.900405 17236 rpcz_store.cc:276] 0929 11:37:06.615734 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.622845 (+ 7111us) service_pool.cc:227] Handling call
0929 11:37:06.782168 (+159323us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.901496 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.902485 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 263) took 1308 ms. Trace:
I20260929 11:37:07.651198 17465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 264) took 1314 ms. Trace:
I20260929 11:37:07.902896 17236 rpcz_store.cc:276] 0929 11:37:06.593956 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.901204 (+1307248us) service_pool.cc:227] Handling call
0929 11:37:07.902413 (+ 1209us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.652614 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.904898 17386 raft_consensus.cc:2454] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:07.904199 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:37:07.905638 17386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 210) took 1684 ms (client timeout 1514 ms). Trace:
W20260929 11:37:07.906060 17386 rpcz_store.cc:269] 0929 11:37:06.221270 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.652272 (+1431002us) service_pool.cc:227] Handling call
0929 11:37:07.905525 (+253253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.906705 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a68f6896d44d2ca026dcb8e903d1c9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.685786 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47682 (request call id 306) took 1085 ms. Trace:
I20260929 11:37:07.687760 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.919246 17243 rpcz_store.cc:276] 0929 11:37:06.600021 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.658291 (+ 58270us) service_pool.cc:227] Handling call
0929 11:37:06.825576 (+167285us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:07.685715 (+860139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":111534976}
I20260929 11:37:07.920236 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.920641 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.921193 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47682 (request call id 303) took 1322 ms. Trace:
I20260929 11:37:07.921556 17239 rpcz_store.cc:276] 0929 11:37:06.599059 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.919938 (+1320879us) service_pool.cc:227] Handling call
0929 11:37:07.921138 (+ 1200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.922520 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:06.842375 17355 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:07.903102 18622 raft_consensus.cc:2741] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260929 11:37:07.924368 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 1.08875e+06us
I20260929 11:37:07.925798 17355 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:07.687749 18611 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:07.690745 17242 raft_consensus.cc:2379] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:07.927263 18613 raft_consensus.cc:2781] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:07.692165 17282 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:07.927680 18613 raft_consensus.cc:482] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:07.927734 18555 raft_consensus.cc:2781] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:07.928104 18613 raft_consensus.cc:3037] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:07.928452 18181 raft_consensus.cc:2726] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:07.692226 18197 raft_consensus.cc:482] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:07.929196 18197 raft_consensus.cc:504] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:07.931308 18197 leader_election.cc:288] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:07.931535 17355 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:07.931869 18197 raft_consensus.cc:2781] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:06.858389 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:07.704931 17235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47704 (request call id 273) took 3383 ms (client timeout 1649 ms). Trace:
W20260929 11:37:07.932993 17235 rpcz_store.cc:269] 0929 11:37:04.321554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:04.323026 (+ 1472us) service_pool.cc:227] Handling call
0929 11:37:04.805261 (+482235us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:06.143370 (+1338109us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934c6c 00007f79b6934bd6 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7d61b0 00007f79be7d5a94 00007f79b7ebdc04 00007f79b7ebdb92
0929 11:37:07.704742 (+1561372us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54002d7dd4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:07.704872 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":545269760}
I20260929 11:37:07.932686 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 260) took 1339 ms. Trace:
I20260929 11:37:07.934388 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.934496 17239 rpcz_store.cc:276] 0929 11:37:06.593048 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.922229 (+1329181us) service_pool.cc:227] Handling call
0929 11:37:07.932625 (+ 10396us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.718783 17315 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 317) took 1202 ms. Trace:
I20260929 11:37:07.719270 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 254) took 1197 ms. Trace:
I20260929 11:37:07.935650 17241 rpcz_store.cc:276] 0929 11:37:06.522135 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.539889 (+ 17754us) service_pool.cc:227] Handling call
0929 11:37:07.719094 (+1179205us) spinlock_profiling.cc:243] Waited 88 ms on lock 0x7b5400105c54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:07.719209 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":202293504}
I20260929 11:37:07.738006 18525 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:07.936599 18525 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:07.937337 18621 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:07.937754 18621 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:07.938078 18621 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:07.938728 18525 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:07.738986 18307 raft_consensus.cc:2781] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:07.939358 18307 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:07.939752 18307 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:07.935505 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:07.942123 17239 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:07.743577 18537 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:07.755223 18240 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:07.752007 18522 raft_consensus.cc:482] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:07.944726 18240 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:07.944599 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 1.14064e+06us
I20260929 11:37:07.944931 18522 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:07.946113 17283 leader_election.cc:302] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:07.947016 18240 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:37:07.757074 17387 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 197) took 2957 ms (client timeout 2170 ms). Trace:
I20260929 11:37:07.789461 18027 raft_consensus.cc:2741] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260929 11:37:07.948009 17237 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:07.812259 17388 rpcz_store.cc:276] 0929 11:37:06.584008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.810960 (+1226952us) service_pool.cc:227] Handling call
0929 11:37:07.811915 (+ 955us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.808195 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.814211 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 207) took 1594 ms. Trace:
I20260929 11:37:07.816046 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.821342 17392 raft_consensus.cc:2454] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:07.836690 17234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 271) took 1240 ms. Trace:
I20260929 11:37:07.825304 17238 rpcz_store.cc:276] 0929 11:37:06.574007 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.617799 (+ 43792us) service_pool.cc:227] Handling call
0929 11:37:07.037589 (+419790us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b58001e3398. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934bce 000000000034aea9 00007f79be760a30 00007f79be8267b4 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:07.037760 (+ 171us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:07.824540 (+786780us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:07.824768 (+ 228us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5964672}
I20260929 11:37:07.950476 17385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 288) took 1069 ms. Trace:
I20260929 11:37:07.950376 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.951014 17385 rpcz_store.cc:276] 0929 11:37:06.881140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.807956 (+926816us) service_pool.cc:227] Handling call
0929 11:37:07.950416 (+142460us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.944662 18537 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:07.840401 18275 raft_consensus.cc:2781] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:07.841485 17391 raft_consensus.cc:2379] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
W20260929 11:37:07.842056 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:37:07.842852 17383 raft_consensus.cc:2454] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:07.932636 17316 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:07.847757 18016 leader_election.cc:288] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:07.834504 17140 catalog_manager.cc:5495] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } }
I20260929 11:37:07.953266 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 280) took 1345 ms. Trace:
I20260929 11:37:07.859712 18443 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:07.953811 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 248) took 1371 ms. Trace:
I20260929 11:37:07.857442 18299 consensus_queue.cc:1035] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:07.950141 17234 rpcz_store.cc:276] 0929 11:37:06.606437 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.116716 (+510279us) service_pool.cc:227] Handling call
0929 11:37:07.836633 (+719917us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30464}
I20260929 11:37:07.954262 17391 rpcz_store.cc:276] 0929 11:37:06.582648 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.836379 (+1253731us) service_pool.cc:227] Handling call
0929 11:37:07.953758 (+117379us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.954528 18299 consensus_queue.cc:1225] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer 013a37bea2eb40c0ad4ce8f296176573 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260929 11:37:07.955296 18443 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:07.864905 17384 raft_consensus.cc:2396] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:07.865658 18448 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:07.953173 18537 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:07.869724 18342 consensus_queue.cc:1035] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:07.956364 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.873518 17357 leader_election.cc:302] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:07.957126 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.957232 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 290) took 1075 ms. Trace:
W20260929 11:37:07.957576 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 84182.1us
I20260929 11:37:07.957751 17241 raft_consensus.cc:2454] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:07.957810 17388 rpcz_store.cc:276] 0929 11:37:06.881867 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.956079 (+1074212us) service_pool.cc:227] Handling call
0929 11:37:07.957157 (+ 1078us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.958654 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.959455 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48776 (request call id 324) took 1123 ms. Trace:
I20260929 11:37:07.959856 17357 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:06.837568 18509 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:07.876919 18616 raft_consensus.cc:2726] T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260929 11:37:07.947731 17387 rpcz_store.cc:269] 0929 11:37:04.799334 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.756810 (+2957476us) service_pool.cc:214] Skipping call since client already timed out
0929 11:37:07.756989 (+ 179us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260929 11:37:07.961323 18616 raft_consensus.cc:2726] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:07.961694 17235 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:07.961930 18616 consensus_queue.cc:1046] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:07.962320 18509 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:07.887527 18549 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:07.935298 17315 rpcz_store.cc:276] 0929 11:37:06.516753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.525505 (+ 8752us) service_pool.cc:227] Handling call
0929 11:37:07.716649 (+1191144us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5800005198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:07.716909 (+ 260us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:07.717131 (+ 222us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:07.718458 (+ 1327us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:07.718520 (+ 62us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:07.718570 (+ 50us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:07.718622 (+ 52us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:07.718731 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":44953984}
I20260929 11:37:07.963250 18549 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:07.947664 17283 leader_election.cc:398] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Vote denied by peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835) with higher term. Message: Invalid argument: T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 4. Current term is 5.
I20260929 11:37:07.932260 18197 raft_consensus.cc:482] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:07.964668 18275 raft_consensus.cc:482] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:07.964906 18197 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:07.965087 18275 raft_consensus.cc:3037] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:07.965365 18549 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:07.953263 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 216) took 1220 ms. Trace:
I20260929 11:37:07.966178 17241 raft_consensus.cc:2379] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:07.966253 17390 rpcz_store.cc:276] 0929 11:37:06.732805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.815751 (+1082946us) service_pool.cc:227] Handling call
0929 11:37:07.953207 (+137456us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.967232 17390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:07.967569 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.897307 18585 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:07.928223 18555 raft_consensus.cc:482] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:07.959141 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db3516ecd8394495878d2f749d8fa27d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.968437 18555 raft_consensus.cc:3037] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:07.968969 17388 raft_consensus.cc:2379] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:07.969421 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 291) took 1087 ms. Trace:
I20260929 11:37:07.969723 17388 rpcz_store.cc:276] 0929 11:37:06.882220 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.958791 (+1076571us) service_pool.cc:227] Handling call
0929 11:37:07.969332 (+ 10541us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.970582 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:07.962033 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.971800 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 292) took 1089 ms. Trace:
I20260929 11:37:07.875188 18506 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:07.668007 18610 raft_consensus.cc:482] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:07.972092 17387 rpcz_store.cc:276] 0929 11:37:06.882507 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.961737 (+1079230us) service_pool.cc:227] Handling call
0929 11:37:07.971747 (+ 10010us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.972788 18610 raft_consensus.cc:504] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:07.973142 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.973869 18506 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:07.964356 17283 leader_election.cc:401] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260929 11:37:07.952078 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edae75a1c2e04d0d9d7a5e7e26fcdcce" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.953841 17383 rpcz_store.cc:276] 0929 11:37:06.607714 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.823090 (+1215376us) service_pool.cc:227] Handling call
0929 11:37:07.953204 (+130114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.974885 17385 raft_consensus.cc:2454] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:07.975069 18611 raft_consensus.cc:2726] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835) with higher term. Message: Invalid argument: T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 4. Current term is 5.
I20260929 11:37:07.975525 17385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 289) took 1094 ms. Trace:
I20260929 11:37:07.975689 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.975891 17385 rpcz_store.cc:276] 0929 11:37:06.881528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.951815 (+1070287us) service_pool.cc:227] Handling call
0929 11:37:07.975468 (+ 23653us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.673262 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:07.976562 17383 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:07.955310 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f8d27c3483f4e0eadb60439434a5faa" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.959864 17316 rpcz_store.cc:276] 0929 11:37:06.835865 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.843670 (+ 7805us) service_pool.cc:227] Handling call
0929 11:37:07.959365 (+1115695us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.908790 18586 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:07.977025 17240 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 5: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:07.978439 17237 raft_consensus.cc:2454] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:07.979059 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47682 (request call id 308) took 1378 ms. Trace:
I20260929 11:37:07.978736 18586 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:07.979436 17240 rpcz_store.cc:276] 0929 11:37:06.600686 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.780962 (+180276us) service_pool.cc:227] Handling call
0929 11:37:07.979007 (+1198045us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.980343 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.980873 17240 raft_consensus.cc:2454] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:07.981411 18586 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:07.918035 18355 raft_consensus.cc:3032] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:07.982082 18355 raft_consensus.cc:729] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
W20260929 11:37:07.982599 17384 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 198) took 3183 ms (client timeout 2517 ms). Trace:
W20260929 11:37:07.929555 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 214081us
W20260929 11:37:07.983179 17384 rpcz_store.cc:269] 0929 11:37:04.799609 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.018288 (+2218679us) service_pool.cc:227] Handling call
0929 11:37:07.982391 (+964103us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b540054b854. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:07.982534 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":97486592}
I20260929 11:37:07.983232 18355 consensus_queue.cc:260] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:07.984515 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.983481 17357 leader_election.cc:302] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:07.985327 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 249) took 1402 ms. Trace:
I20260929 11:37:07.985376 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:07.986893 18448 raft_consensus.cc:2781] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:07.987308 18448 raft_consensus.cc:482] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:07.984696 18355 raft_consensus.cc:3037] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:07.987638 18448 raft_consensus.cc:3037] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:07.988054 18443 raft_consensus.cc:2726] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:07.963253 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:07.989006 17235 raft_consensus.cc:3037] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:07.948266 18027 raft_consensus.cc:2781] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:07.989781 18027 raft_consensus.cc:482] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:07.990144 18027 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:07.985726 17384 rpcz_store.cc:276] 0929 11:37:06.582959 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.984231 (+1401272us) service_pool.cc:227] Handling call
0929 11:37:07.985268 (+ 1037us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.977058 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 263) took 1649 ms. Trace:
I20260929 11:37:07.994035 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:07.766542 17462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56190 (request call id 277) took 1267 ms. Trace:
I20260929 11:37:07.995540 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:07.995817 17462 rpcz_store.cc:276] 0929 11:37:06.499140 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.532546 (+ 33406us) service_pool.cc:227] Handling call
0929 11:37:07.766330 (+1233784us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54005631d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:07.766478 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":50617728}
I20260929 11:37:07.973914 17387 raft_consensus.cc:2454] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:07.949548 17389 rpcz_store.cc:276] 0929 11:37:06.219415 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.780295 (+560880us) service_pool.cc:227] Handling call
0929 11:37:07.814152 (+1033857us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.996814 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
W20260929 11:37:07.839785 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 985893us
I20260929 11:37:07.951117 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c68e526f10e41d28e5d99b4d239f940" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.998174 17431 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:07.998451 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.999203 17238 raft_consensus.cc:2454] T dda74a7e6ff64812814139f0aedd4baf P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:07.999445 17431 leader_election.cc:302] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:07.999408 18585 raft_consensus.cc:504] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:07.955377 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:07.954155 17140 catalog_manager.cc:5495] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } }
I20260929 11:37:08.000639 17391 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:07.953485 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 254) took 1369 ms. Trace:
I20260929 11:37:08.001137 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59224 (request call id 256) took 1387 ms. Trace:
I20260929 11:37:08.001564 18585 leader_election.cc:288] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.001091 17140 catalog_manager.cc:5495] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 2, leader changed from bb8e3505668b40219823840c0d8bc3af (127.13.221.195) to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 2 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } }
I20260929 11:37:08.001689 17391 rpcz_store.cc:276] 0929 11:37:06.613246 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.955100 (+1341854us) service_pool.cc:227] Handling call
0929 11:37:08.001082 (+ 45982us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.002236 18585 raft_consensus.cc:2781] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader election won for term 2
I20260929 11:37:07.947352 18522 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:07.903245 17465 rpcz_store.cc:276] 0929 11:37:06.336665 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.337606 (+ 941us) service_pool.cc:227] Handling call
0929 11:37:06.338020 (+ 414us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:06.456760 (+118740us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:06.475490 (+ 18730us) log.cc:842] Serialized 14 byte log entry
0929 11:37:06.496104 (+ 20614us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:06.496157 (+ 53us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:06.505613 (+ 9456us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:06.898883 (+393270us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800273b20. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b696c638 00007f79b696fb11 00007f79b696fac9 00007f79b696fa59 00007f79b696fa21 00007f79b696ed1d 00007f79bfbd0204 00007f79bfbd0039 00007f79b694edc6
0929 11:37:07.132811 (+233928us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b1800273b20. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79bf80b8b1 00007f79bf818661 00007f79b6939f96 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9
0929 11:37:07.650854 (+518043us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400634054. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:07.650899 (+ 45us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:07.651039 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":40873,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":316,"raft.queue_time_us":9601,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":80056,"spinlock_wait_cycles":306219008,"thread_start_us":37279,"threads_started":2,"wal-append.queue_time_us":132786,"wal-append.run_cpu_time_us":23468,"wal-append.run_wall_time_us":1001587}
I20260929 11:37:08.003146 18537 raft_consensus.cc:2781] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:08.001272 17392 rpcz_store.cc:276] 0929 11:37:06.584287 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.797192 (+212905us) service_pool.cc:227] Handling call
0929 11:37:07.953434 (+1156242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.003584 18537 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:07.974881 18610 leader_election.cc:288] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:07.993597 17383 rpcz_store.cc:276] 0929 11:37:06.327293 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.975432 (+1648139us) service_pool.cc:227] Handling call
0929 11:37:07.976979 (+ 1547us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.927788 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47696 (request call id 272) took 1287 ms. Trace:
I20260929 11:37:07.967737 17390 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.001223 17431 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:08.004420 17242 rpcz_store.cc:276] 0929 11:37:06.640705 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:06.776096 (+135391us) service_pool.cc:227] Handling call
0929 11:37:07.927727 (+1151631us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.005367 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.006188 17242 raft_consensus.cc:2396] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:08.007045 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:07.978387 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.007642 17242 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:08.008562 18452 raft_consensus.cc:2781] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:07.994269 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.008920 17234 raft_consensus.cc:1226] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 4. Ops: []
W20260929 11:37:07.928175 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 236119us
I20260929 11:37:08.010190 17282 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:07.981632 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.011157 17282 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:08.011497 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.011613 17240 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:07.887668 18530 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:08.012173 17465 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:08.000114 17238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.012584 18530 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.013588 17238 raft_consensus.cc:2396] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:08.013815 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:07.997443 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.015728 17389 raft_consensus.cc:2454] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:08.014768 18530 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.016526 17241 raft_consensus.cc:2454] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:07.906984 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.016184 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 217) took 1265 ms. Trace:
I20260929 11:37:08.017063 18611 raft_consensus.cc:2781] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:08.016816 17240 raft_consensus.cc:1226] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260929 11:37:08.017243 17389 rpcz_store.cc:276] 0929 11:37:06.750866 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.997211 (+1246345us) service_pool.cc:227] Handling call
0929 11:37:08.016120 (+ 18909us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.017535 18611 raft_consensus.cc:482] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:08.018163 18611 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.002640 17140 catalog_manager.cc:5495] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 3, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 3 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } }
I20260929 11:37:07.996968 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 215) took 1285 ms. Trace:
I20260929 11:37:08.016702 17243 raft_consensus.cc:2454] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:08.025046 17387 rpcz_store.cc:276] 0929 11:37:06.711988 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.972882 (+1260894us) service_pool.cc:227] Handling call
0929 11:37:07.996911 (+ 24029us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.884836 18620 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:08.009668 17234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 259) took 1417 ms. Trace:
I20260929 11:37:08.026268 18620 raft_consensus.cc:504] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:08.026538 17234 rpcz_store.cc:276] 0929 11:37:06.592651 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.008426 (+1415775us) service_pool.cc:227] Handling call
0929 11:37:08.008741 (+ 315us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.009422 (+ 681us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.009616 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.027109 17243 raft_consensus.cc:1226] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 3. Ops: []
I20260929 11:37:08.027858 17243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 265) took 1433 ms. Trace:
I20260929 11:37:07.988202 17357 leader_election.cc:302] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:08.008988 18452 raft_consensus.cc:482] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:08.017485 17386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 285) took 1190 ms. Trace:
I20260929 11:37:08.024885 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.028610 18452 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.028764 17386 rpcz_store.cc:276] 0929 11:37:06.827499 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.906713 (+1079214us) service_pool.cc:227] Handling call
0929 11:37:08.017428 (+110715us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.029193 17458 raft_consensus.cc:2379] T ef0ba93c758b44c68b9eebc4712f42cd P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 4: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:08.030295 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 279) took 1499 ms. Trace:
I20260929 11:37:08.004002 18537 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:07.923496 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbfc6a09e844768909a2044d9cb8066" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.030287 17282 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:08.032670 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 261) took 1439 ms. Trace:
I20260929 11:37:08.011773 18555 raft_consensus.cc:504] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:08.033149 17240 rpcz_store.cc:276] 0929 11:37:06.593368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.012347 (+1418979us) service_pool.cc:227] Handling call
0929 11:37:08.016561 (+ 4214us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.032397 (+ 15836us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.032613 (+ 216us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.024936 17140 catalog_manager.cc:5495] T ef22bce609f94dd4b4c3f039c01e473e P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 4, leader changed from 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193) to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 4 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260929 11:37:08.035279 18443 raft_consensus.cc:2781] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:08.036707 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.028174 17243 rpcz_store.cc:276] 0929 11:37:06.594559 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.026574 (+1432015us) service_pool.cc:227] Handling call
0929 11:37:08.026932 (+ 358us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.027606 (+ 674us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.027803 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.038826 17389 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:08.044938 17239 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 5.
W20260929 11:37:08.046473 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 58411.6us
I20260929 11:37:08.035586 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.048996 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 283) took 1276 ms. Trace:
I20260929 11:37:08.049033 18448 raft_consensus.cc:504] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.053895 18448 leader_election.cc:288] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.054159 17238 raft_consensus.cc:1226] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:08.057695 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.049515 17391 rpcz_store.cc:276] 0929 11:37:06.773117 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.002552 (+1229435us) service_pool.cc:227] Handling call
0929 11:37:08.048934 (+ 46382us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:07.935699 18613 raft_consensus.cc:504] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.078320 17390 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 5.
I20260929 11:37:08.078981 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59236 (request call id 219) took 1278 ms. Trace:
I20260929 11:37:08.079205 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.079487 17389 raft_consensus.cc:1226] T 6e1e2488d0f744f5913ac947362f1e27 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 3. Current term is 5. Ops: []
I20260929 11:37:08.051239 17392 raft_consensus.cc:1226] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:08.028544 17234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 267) took 1433 ms. Trace:
I20260929 11:37:08.012526 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.047260 17357 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:08.052152 18610 raft_consensus.cc:2781] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:08.080042 18586 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:08.085748 18610 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:08.086150 18610 raft_consensus.cc:3037] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.086524 17357 leader_election.cc:398] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Vote denied by peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361) with higher term. Message: Invalid argument: T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4.
I20260929 11:37:08.086876 17357 leader_election.cc:401] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260929 11:37:08.030721 17384 rpcz_store.cc:276] 0929 11:37:06.530888 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.993776 (+1462888us) service_pool.cc:227] Handling call
0929 11:37:08.030240 (+ 36464us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.088292 17357 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:08.088435 17384 raft_consensus.cc:1261] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:08.038968 17140 catalog_manager.cc:5495] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 2 to 3, leader changed from 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196) to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 3 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:37:08.015966 18307 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.070628 18443 raft_consensus.cc:686] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:08.070819 17240 raft_consensus.cc:1261] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:08.099540 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 304) took 1500 ms. Trace:
I20260929 11:37:08.100037 17240 rpcz_store.cc:276] 0929 11:37:06.599374 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.037752 (+1438378us) service_pool.cc:227] Handling call
0929 11:37:08.058105 (+ 20353us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.099225 (+ 41120us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.099478 (+ 253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.033357 18622 raft_consensus.cc:2726] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260929 11:37:08.070914 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 143026us
I20260929 11:37:08.071816 17387 raft_consensus.cc:1226] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 4. Ops: []
I20260929 11:37:08.072428 18275 raft_consensus.cc:504] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.074054 18197 raft_consensus.cc:504] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.110772 18621 raft_consensus.cc:504] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:08.111303 18197 leader_election.cc:288] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:08.075939 18555 leader_election.cc:288] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.078265 17356 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:08.113670 18623 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:08.114064 18623 raft_consensus.cc:482] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:08.114248 18621 leader_election.cc:288] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.114427 18623 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.051339 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 301) took 1475 ms. Trace:
I20260929 11:37:08.115316 18537 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.002797 18585 raft_consensus.cc:686] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:08.125368 18585 consensus_queue.cc:237] T cb100fbaa5d4434c9b62299d39e52992 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.079248 17390 rpcz_store.cc:276] 0929 11:37:06.801318 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.966985 (+1165667us) service_pool.cc:227] Handling call
0929 11:37:08.078931 (+111946us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.127413 17390 raft_consensus.cc:1226] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:08.127995 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 232) took 4387 ms. Trace:
I20260929 11:37:08.079862 17239 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
W20260929 11:37:08.085115 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 78383.1us
I20260929 11:37:08.077505 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 189) took 5011 ms. Trace:
I20260929 11:37:08.086088 18586 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.094271 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 190) took 5023 ms. Trace:
I20260929 11:37:08.086082 18355 raft_consensus.cc:2781] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:08.094947 18342 raft_consensus.cc:2726] T db5a4fd4ad3a4bba9a69926ef6ba204d P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361) with higher term. Message: Invalid argument: T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4.
I20260929 11:37:08.095366 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 255) took 5322 ms. Trace:
I20260929 11:37:08.095461 17235 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:08.139042 18463 raft_consensus.cc:482] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:08.138859 17392 rpcz_store.cc:276] 0929 11:37:02.766471 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.003813 (+5237342us) service_pool.cc:227] Handling call
0929 11:37:08.050874 (+ 47061us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b580004d198. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b6934851 00007f79b6934702 00007f79bf824b09 00007f79be760730 00007f79be82679b 00007f79be826821 00007f79be7ea2b0 00007f79be7d57f9 00007f79be7d52a2 00007f79b7ebb684
0929 11:37:08.051074 (+ 200us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.088961 (+ 37887us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.089151 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":76304640}
I20260929 11:37:08.139635 18463 raft_consensus.cc:504] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.096046 18624 raft_consensus.cc:2726] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:08.096266 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 187) took 5161 ms. Trace:
I20260929 11:37:08.095486 17357 leader_election.cc:302] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:08.089965 17140 catalog_manager.cc:5495] T 84d908c031db44039f013807daaa3507 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260929 11:37:08.056170 17238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 262) took 1462 ms. Trace:
I20260929 11:37:08.102416 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99e908ebf22e447487392401adf8bfd8" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.104194 18620 leader_election.cc:288] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:08.105090 18443 consensus_queue.cc:237] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.105762 18611 raft_consensus.cc:504] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.106472 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.096663 18452 raft_consensus.cc:504] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.108258 17355 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:08.115540 17242 rpcz_store.cc:276] 0929 11:37:06.576095 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.033113 (+1457018us) service_pool.cc:227] Handling call
0929 11:37:08.040813 (+ 7700us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.051038 (+ 10225us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.051065 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:08.051106 (+ 41us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:08.051132 (+ 26us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.051192 (+ 60us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.051290 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.082638 17234 rpcz_store.cc:276] 0929 11:37:06.595145 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.027480 (+1432335us) service_pool.cc:227] Handling call
0929 11:37:08.027950 (+ 470us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.028168 (+ 218us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.028201 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:08.028255 (+ 54us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:08.028311 (+ 56us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.028390 (+ 79us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.028492 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.119724 17463 raft_consensus.cc:2379] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:08.120186 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.121809 18275 leader_election.cc:288] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.122439 18610 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.123332 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 188) took 5176 ms. Trace:
I20260929 11:37:08.124212 18537 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:08.117436 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:08.123337 18623 raft_consensus.cc:504] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.104312 17388 raft_consensus.cc:2354] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:37:08.050482 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:37:08.128441 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 151673us
I20260929 11:37:08.128291 17390 rpcz_store.cc:276] 0929 11:37:03.740062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.126850 (+4386788us) service_pool.cc:227] Handling call
0929 11:37:08.127204 (+ 354us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.127744 (+ 540us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.127925 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:08.129504 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 99293.3us
I20260929 11:37:08.134734 17239 raft_consensus.cc:1226] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:08.137741 18586 leader_election.cc:288] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.138446 18355 raft_consensus.cc:686] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:08.140185 17235 raft_consensus.cc:1261] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:08.082518 18027 raft_consensus.cc:504] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.140811 17236 raft_consensus.cc:1226] T 4f710cc4eabc43cb9d15d956a7d405ec P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:08.150565 17389 rpcz_store.cc:276] 0929 11:37:02.935258 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.056646 (+5121388us) service_pool.cc:227] Handling call
0929 11:37:08.079332 (+ 22686us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.080521 (+ 1189us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.096056 (+ 15535us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b54004aae50. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:08.096186 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":51355904}
I20260929 11:37:08.140857 17392 pending_rounds.cc:76] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af: Aborting all ops after (but not including) 1
I20260929 11:37:08.152943 17140 catalog_manager.cc:5495] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 3, leader changed from 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196) to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 3 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:37:08.154139 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.154438 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.374794 17431 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:08.375404 17466 raft_consensus.cc:3037] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
@ 0x7f79b32907f1 abort at ??:0
I20260929 11:37:08.376130 17242 raft_consensus.cc:1261] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:08.376842 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 315) took 1270 ms. Trace:
I20260929 11:37:08.377133 17242 rpcz_store.cc:276] 0929 11:37:07.106226 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.375484 (+1269258us) service_pool.cc:227] Handling call
0929 11:37:08.375814 (+ 330us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.376604 (+ 790us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.376788 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.377669 17241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 264) took 1783 ms. Trace:
I20260929 11:37:08.156351 17460 raft_consensus.cc:1226] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:08.378945 18634 consensus_queue.cc:1035] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:37:08.361526 18307 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.138886 18464 raft_consensus.cc:482] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:08.381116 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59212 (request call id 293) took 1498 ms. Trace:
I20260929 11:37:08.381572 18464 raft_consensus.cc:504] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.381669 17388 rpcz_store.cc:276] 0929 11:37:06.882777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:07.970324 (+1087547us) service_pool.cc:227] Handling call
0929 11:37:08.380921 (+410597us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002a17d4. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b98982ae 00007f79be7d5c27 00007f79b7ebdc04 00007f79b7ebdb92 00007f79b7ebdac1 00007f79b7ebda3c 00007f79b7ebccf2 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:08.381043 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":305977216}
I20260929 11:37:08.382262 18611 leader_election.cc:288] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:08.349685 14204 debug-util.cc:398] Leaking SignalData structure 0x7b080000ed80 after lost signal to thread 17283
I20260929 11:37:08.154819 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.384202 17240 raft_consensus.cc:2454] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:08.384392 17461 raft_consensus.cc:2454] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:08.378028 17241 rpcz_store.cc:276] 0929 11:37:06.594248 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.017206 (+1422958us) service_pool.cc:227] Handling call
0929 11:37:08.017500 (+ 294us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.018184 (+ 684us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.018216 (+ 32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:08.018651 (+ 435us) log.cc:842] Serialized 26 byte log entry
0929 11:37:08.322541 (+303890us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:08.322596 (+ 55us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.322700 (+ 104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:08.377468 (+ 54768us) raft_consensus.cc:1671] finished
0929 11:37:08.377487 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.377602 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"thread_start_us":303400,"threads_started":1,"wal-append.queue_time_us":356999}
W20260929 11:37:08.198262 17208 leader_election.cc:334] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 1.579s (SENT)
I20260929 11:37:08.386040 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.386389 17208 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:08.386583 17462 raft_consensus.cc:2454] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:08.387148 18530 raft_consensus.cc:2726] T 99e908ebf22e447487392401adf8bfd8 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:08.380970 17387 rpcz_store.cc:276] 0929 11:37:02.946753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.071174 (+5124421us) service_pool.cc:227] Handling call
0929 11:37:08.071586 (+ 412us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.123002 (+ 51416us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.123265 (+ 263us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.132483 17384 rpcz_store.cc:276] 0929 11:37:03.071043 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.087629 (+5016586us) service_pool.cc:227] Handling call
0929 11:37:08.088027 (+ 398us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.088842 (+ 815us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.094182 (+ 5340us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:08.388231 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 190024us
I20260929 11:37:08.388444 18275 consensus_queue.cc:1035] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:08.388907 18634 raft_consensus.cc:3037] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:08.389196 17236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47696 (request call id 268) took 1793 ms. Trace:
I20260929 11:37:08.389566 17236 rpcz_store.cc:276] 0929 11:37:06.595479 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.033537 (+1438058us) service_pool.cc:227] Handling call
0929 11:37:08.140585 (+107048us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.388474 (+247889us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.389038 (+ 564us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b5400395150. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:08.389147 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":226524544}
I20260929 11:37:08.390190 18452 leader_election.cc:288] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:37:08.390416 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 295029us
I20260929 11:37:08.390837 17239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 307) took 1790 ms. Trace:
I20260929 11:37:08.391141 17239 rpcz_store.cc:276] 0929 11:37:06.600363 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.131895 (+1531532us) service_pool.cc:227] Handling call
0929 11:37:08.134496 (+ 2601us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.390585 (+256089us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.390751 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.392096 17235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 310) took 1777 ms. Trace:
W20260929 11:37:08.392654 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 284479us
I20260929 11:37:08.393216 18355 consensus_queue.cc:237] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:08.394009 18624 consensus_queue.cc:1035] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:37:08.396505 17241 pending_rounds.cc:76] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Aborting all ops after (but not including) 1
I20260929 11:37:08.396623 17386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 236) took 4642 ms. Trace:
I20260929 11:37:08.396875 17241 pending_rounds.cc:97] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260929 11:37:08.397292 17241 raft_consensus.cc:2866] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:37:08.397802 18027 leader_election.cc:288] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:08.398361 17392 pending_rounds.cc:97] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260929 11:37:08.398675 17392 raft_consensus.cc:2866] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:37:08.399411 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:08.400938 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:08.401312 17389 raft_consensus.cc:1203] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Deduplicated request from leader. Original: 1.1->[4.2-4.2] Dedup: 4.2->[]
I20260929 11:37:08.380246 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.387449 18610 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:08.405799 17460 raft_consensus.cc:2379] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:08.356181 18463 leader_election.cc:288] T 4f710cc4eabc43cb9d15d956a7d405ec P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.408180 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.409178 17459 raft_consensus.cc:2396] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260929 11:37:08.410012 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.410208 18623 leader_election.cc:288] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.410662 17459 raft_consensus.cc:2454] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:08.410873 17243 raft_consensus.cc:2454] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:08.411324 17282 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:08.412210 18622 raft_consensus.cc:2781] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:08.412257 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:08.412811 18622 raft_consensus.cc:482] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:08.413331 18622 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.157380 18555 raft_consensus.cc:2726] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260929 11:37:08.414170 18464 leader_election.cc:288] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.392442 17235 rpcz_store.cc:276] 0929 11:37:06.614858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.139357 (+1524499us) service_pool.cc:227] Handling call
0929 11:37:08.139750 (+ 393us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.391873 (+252123us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.392047 (+ 174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.150357 17238 rpcz_store.cc:276] 0929 11:37:06.593692 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.014206 (+1420514us) service_pool.cc:227] Handling call
0929 11:37:08.053984 (+ 39778us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.054585 (+ 601us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.055981 (+ 1396us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b540059b5d0. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9893a09 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86 00007f79b7cbd72f
0929 11:37:08.056113 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":90758528}
I20260929 11:37:08.415307 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:08.415856 17235 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.417164 17385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 256) took 5485 ms. Trace:
I20260929 11:37:08.417013 17282 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:08.418066 18610 raft_consensus.cc:2781] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:08.418180 17282 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:08.418509 18610 raft_consensus.cc:482] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:08.418870 18610 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.412824 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.419476 17457 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.155022 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.420590 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db5a4fd4ad3a4bba9a69926ef6ba204d" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.421245 17462 raft_consensus.cc:3037] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.421651 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 246) took 3661 ms. Trace:
I20260929 11:37:08.422077 17384 rpcz_store.cc:276] 0929 11:37:04.759886 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.420756 (+3660870us) service_pool.cc:227] Handling call
0929 11:37:08.421110 (+ 354us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.421317 (+ 207us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.421344 (+ 27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:08.421393 (+ 49us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:08.421424 (+ 31us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.421483 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.421595 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.423725 17384 raft_consensus.cc:1261] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:08.374208 18613 leader_election.cc:288] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:08.424548 18631 raft_consensus.cc:2781] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:08.395684 17140 catalog_manager.cc:5495] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 3, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 3 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } }
I20260929 11:37:08.425017 18631 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:08.425223 17387 raft_consensus.cc:1226] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:08.425437 18631 raft_consensus.cc:3037] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.426160 17389 raft_consensus.cc:1226] T 2303ddc899e94157b6c5ad7185a7a9bc P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260929 11:37:08.426791 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 259) took 4669 ms. Trace:
I20260929 11:37:08.427649 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.129616 17391 rpcz_store.cc:276] 0929 11:37:03.065688 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.076575 (+5010887us) service_pool.cc:227] Handling call
0929 11:37:08.076949 (+ 374us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.077139 (+ 190us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.077163 (+ 24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:08.077201 (+ 38us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:08.077233 (+ 32us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.077292 (+ 59us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.077420 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.429644 17391 raft_consensus.cc:1226] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:08.430326 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 194) took 3631 ms. Trace:
I20260929 11:37:08.430702 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 192) took 3632 ms. Trace:
I20260929 11:37:08.430830 17391 rpcz_store.cc:276] 0929 11:37:04.798515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.429101 (+3630586us) service_pool.cc:227] Handling call
0929 11:37:08.429472 (+ 371us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.430047 (+ 575us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.430263 (+ 216us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.431267 17387 rpcz_store.cc:276] 0929 11:37:04.797970 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.424545 (+3626575us) service_pool.cc:227] Handling call
0929 11:37:08.425047 (+ 502us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.430453 (+ 5406us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.430650 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.429502 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.401515 17234 raft_consensus.cc:3037] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.417606 17385 rpcz_store.cc:276] 0929 11:37:02.931805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.035721 (+5103916us) service_pool.cc:227] Handling call
0929 11:37:08.052837 (+ 17116us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.076663 (+ 23826us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.076696 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:08.077199 (+ 503us) log.cc:842] Serialized 26 byte log entry
0929 11:37:08.284664 (+207465us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:08.303680 (+ 19016us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.416866 (+113186us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:08.416933 (+ 67us) raft_consensus.cc:1671] finished
0929 11:37:08.416944 (+ 11us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.417084 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23417,"raft.queue_time_us":29343,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5831,"thread_start_us":72976,"threads_started":1,"wal-append.queue_time_us":310265}
I20260929 11:37:08.425457 17140 catalog_manager.cc:5495] T 0fbfc6a09e844768909a2044d9cb8066 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } }
I20260929 11:37:08.434777 17140 catalog_manager.cc:5495] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 4, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196). New cstate: current_term: 4 leader_uuid: "26cd298fcaa34c9f93d8793e64f0e863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } }
I20260929 11:37:08.427062 17389 rpcz_store.cc:276] 0929 11:37:03.757361 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.400782 (+4643421us) service_pool.cc:227] Handling call
0929 11:37:08.401165 (+ 383us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.426537 (+ 25372us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.426708 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.438463 18530 consensus_queue.cc:1035] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
@ 0x2a0007 __interceptor_abort at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
I20260929 11:37:08.443164 17389 raft_consensus.cc:1261] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260929 11:37:08.444020 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 267) took 2103 ms. Trace:
I20260929 11:37:08.444409 17389 rpcz_store.cc:276] 0929 11:37:06.340389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.438046 (+2097657us) service_pool.cc:227] Handling call
0929 11:37:08.438451 (+ 405us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.443704 (+ 5253us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.443956 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.444882 18631 raft_consensus.cc:504] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.445546 18027 consensus_queue.cc:1035] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260929 11:37:08.446988 18631 leader_election.cc:288] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:08.447875 17283 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:37:08.448980 17208 leader_election.cc:334] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 1.619s (SENT)
I20260929 11:37:08.449968 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.450258 17387 raft_consensus.cc:1226] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260929 11:37:08.450789 17458 raft_consensus.cc:2379] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 5: Already voted for candidate 26cd298fcaa34c9f93d8793e64f0e863 in this term.
I20260929 11:37:08.450695 17283 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:08.451052 17387 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 199) took 3647 ms. Trace:
I20260929 11:37:08.451733 17458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:37:08.452067 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 77355.3us
I20260929 11:37:08.453536 17208 leader_election.cc:302] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:08.454087 18027 raft_consensus.cc:2781] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:08.451746 18620 raft_consensus.cc:2781] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:08.454545 18027 raft_consensus.cc:482] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:08.454962 18620 raft_consensus.cc:482] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:08.455044 18027 raft_consensus.cc:3037] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.420639 17464 raft_consensus.cc:2454] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:08.456387 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.456957 17464 raft_consensus.cc:2454] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 4.
I20260929 11:37:08.434813 17385 raft_consensus.cc:1226] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:08.457728 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.457877 17385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 261) took 2131 ms. Trace:
I20260929 11:37:08.458810 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.455559 18620 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.460839 17431 leader_election.cc:302] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:08.378715 17242 raft_consensus.cc:1261] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:08.436169 17140 catalog_manager.cc:5495] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 4, leader changed from 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196) to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 4 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:37:08.463690 17464 raft_consensus.cc:2396] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:08.464632 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.465250 17464 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:08.466097 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.424266 17384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 191) took 3626 ms. Trace:
I20260929 11:37:08.466863 17384 rpcz_store.cc:276] 0929 11:37:04.797650 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.423042 (+3625392us) service_pool.cc:227] Handling call
0929 11:37:08.423384 (+ 342us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.424036 (+ 652us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.424216 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.467880 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.458863 18634 raft_consensus.cc:2726] T ec0779c5ab5f4982ac77456eafc8a9e7 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260929 11:37:08.471038 17391 raft_consensus.cc:1261] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:08.471657 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 195) took 3672 ms. Trace:
I20260929 11:37:08.472033 17391 rpcz_store.cc:276] 0929 11:37:04.798789 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.431935 (+3633146us) service_pool.cc:227] Handling call
0929 11:37:08.432302 (+ 367us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.471396 (+ 39094us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.471603 (+ 207us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.470819 17356 leader_election.cc:302] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:08.387395 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.474591 17242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47682 (request call id 318) took 1363 ms. Trace:
I20260929 11:37:08.483076 17242 rpcz_store.cc:276] 0929 11:37:07.106852 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.378139 (+1271287us) service_pool.cc:227] Handling call
0929 11:37:08.378435 (+ 296us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.463140 (+ 84705us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.470491 (+ 7351us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260929 11:37:08.485605 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 83257.2us
W20260929 11:37:08.470750 17413 debug-util.cc:398] Leaking SignalData structure 0x7b080019caa0 after lost signal to thread 14199
W20260929 11:37:08.486192 17413 debug-util.cc:398] Leaking SignalData structure 0x7b080019cb80 after lost signal to thread 14202
I20260929 11:37:08.486364 17355 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:08.486994 17431 leader_election.cc:302] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
W20260929 11:37:08.487219 17413 debug-util.cc:398] Leaking SignalData structure 0x7b0800030960 after lost signal to thread 17175
W20260929 11:37:08.487371 17208 leader_election.cc:334] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 1.626s (SENT)
I20260929 11:37:08.487840 17208 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:08.411650 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.458232 17385 rpcz_store.cc:276] 0929 11:37:06.326359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.434336 (+2107977us) service_pool.cc:227] Handling call
0929 11:37:08.434638 (+ 302us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.457639 (+ 23001us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.457826 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.451494 17387 rpcz_store.cc:276] 0929 11:37:04.803846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.432282 (+3628436us) service_pool.cc:227] Handling call
0929 11:37:08.450008 (+ 17726us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.450735 (+ 727us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.450991 (+ 256us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.464290 17140 catalog_manager.cc:5495] T bad8c633e7dd41be8d3c15ae27c52240 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 4, leader changed from bb8e3505668b40219823840c0d8bc3af (127.13.221.195) to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 4 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260929 11:37:08.489319 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.454545 17460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.501293 17462 raft_consensus.cc:2454] T db5a4fd4ad3a4bba9a69926ef6ba204d P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:08.474225 18530 raft_consensus.cc:2726] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260929 11:37:08.505612 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.502349 17235 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:08.505926 17431 leader_election.cc:398] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Vote denied by peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361) with higher term. Message: Invalid argument: T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5.
I20260929 11:37:08.509717 17431 leader_election.cc:401] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260929 11:37:08.507376 17466 raft_consensus.cc:2454] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 5.
I20260929 11:37:08.483124 18634 raft_consensus.cc:2781] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:08.510773 17466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.516788 17466 raft_consensus.cc:3037] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 1 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.488507 18616 raft_consensus.cc:2781] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:08.447986 18610 raft_consensus.cc:504] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.490922 18463 raft_consensus.cc:2726] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:08.397106 17386 rpcz_store.cc:276] 0929 11:37:03.754035 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.155587 (+4401552us) service_pool.cc:227] Handling call
0929 11:37:08.155989 (+ 402us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.156217 (+ 228us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.156255 (+ 38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:08.156346 (+ 91us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:08.156410 (+ 64us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.156485 (+ 75us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.396546 (+240061us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:08.450573 18622 raft_consensus.cc:504] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:08.504647 17413 debug-util.cc:398] Leaking SignalData structure 0x7b0800312d40 after lost signal to thread 17267
I20260929 11:37:08.525331 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.537748 17464 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.537871 17466 raft_consensus.cc:2454] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:08.527021 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6108e0155a134589a2d418b9fedbe6ca" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.538679 17312 raft_consensus.cc:3037] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.491868 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef22bce609f94dd4b4c3f039c01e473e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.527868 17357 leader_election.cc:302] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:08.529676 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.529949 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.530575 17314 raft_consensus.cc:1226] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 1. Current term is 2. Ops: []
I20260929 11:37:08.532435 17460 raft_consensus.cc:2354] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4.
I20260929 11:37:08.504827 18611 raft_consensus.cc:482] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:08.501747 17461 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:08.509420 18522 raft_consensus.cc:2726] T 2f8d27c3483f4e0eadb60439434a5faa P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:08.509132 18623 consensus_queue.cc:1035] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.030s
I20260929 11:37:08.507634 17140 catalog_manager.cc:5495] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 4, leader changed from a7e500c82a21469ab59f66205205a12a (127.13.221.194) to 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193). New cstate: current_term: 4 leader_uuid: "013a37bea2eb40c0ad4ce8f296176573" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } }
I20260929 11:37:08.521800 18616 raft_consensus.cc:482] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:08.516624 18634 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:08.541208 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.533237 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.556245 17313 raft_consensus.cc:3037] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.529196 18585 raft_consensus.cc:2726] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361) with higher term. Message: Invalid argument: T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5.
W20260929 11:37:08.546528 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 95891.1us
I20260929 11:37:08.564880 17318 raft_consensus.cc:1226] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:08.553375 17140 catalog_manager.cc:5495] T 66c38ca223cc4337b527ebd9abd29cd5 P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 1 to 4, leader changed from 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193) to a7e500c82a21469ab59f66205205a12a (127.13.221.194). New cstate: current_term: 4 leader_uuid: "a7e500c82a21469ab59f66205205a12a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260929 11:37:08.566233 17140 catalog_manager.cc:5495] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a reported cstate change: term changed from 2 to 5, leader changed from 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193) to bb8e3505668b40219823840c0d8bc3af (127.13.221.195). New cstate: current_term: 5 leader_uuid: "bb8e3505668b40219823840c0d8bc3af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } }
I20260929 11:37:08.525206 18624 consensus_queue.cc:1035] T bdf4a53492b14021977a532a11216ba2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260929 11:37:08.539590 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.529847 18621 consensus_queue.cc:1046] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260929 11:37:08.570009 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 70577.9us
I20260929 11:37:08.575067 17431 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:08.575928 17431 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:08.576824 17431 leader_election.cc:302] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:08.572218 17283 leader_election.cc:302] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:08.539935 18631 raft_consensus.cc:482] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:08.575470 17312 raft_consensus.cc:2454] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:08.549456 18623 consensus_queue.cc:1225] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer 013a37bea2eb40c0ad4ce8f296176573 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260929 11:37:08.547031 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.555274 18616 raft_consensus.cc:3037] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.554694 18448 raft_consensus.cc:2726] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260929 11:37:08.564010 18634 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.579545 17459 raft_consensus.cc:1226] T 7e3002f11c7a4c27b73e9842ce11ee63 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:08.588984 17431 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
W20260929 11:37:08.581290 17413 debug-util.cc:398] Leaking SignalData structure 0x7b080030fce0 after lost signal to thread 17342
I20260929 11:37:08.581275 18585 raft_consensus.cc:2781] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:08.582190 18639 raft_consensus.cc:2781] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:08.582109 18342 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:08.573973 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb100fbaa5d4434c9b62299d39e52992" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.582378 18463 raft_consensus.cc:2726] T 2f8d27c3483f4e0eadb60439434a5faa P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:08.580781 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.581542 18631 raft_consensus.cc:504] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.569995 18611 raft_consensus.cc:504] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:08.658353 17312 raft_consensus.cc:1261] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:08.669790 18537 raft_consensus.cc:2781] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:08.651933 18307 raft_consensus.cc:2726] T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:08.589543 18016 consensus_queue.cc:1035] T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.077s
I20260929 11:37:08.669418 17383 raft_consensus.cc:1226] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:08.666393 18555 raft_consensus.cc:3032] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Stepping down as leader of term 1
I20260929 11:37:08.618290 18613 raft_consensus.cc:3037] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:08.659143 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 71758.6us
I20260929 11:37:08.657618 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.663076 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.698676 18649 raft_consensus.cc:2781] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:08.700052 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:37:08.657716 17413 debug-util.cc:398] Leaking SignalData structure 0x7b08003227e0 after lost signal to thread 17343
I20260929 11:37:08.741364 17464 raft_consensus.cc:2454] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
W20260929 11:37:08.682448 18638 log.cc:924] Time spent T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.100s user 0.000s sys 0.000s
W20260929 11:37:08.697573 18641 log.cc:924] Time spent T bad8c633e7dd41be8d3c15ae27c52240 P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.081s user 0.001s sys 0.000s
I20260929 11:37:08.746126 17317 raft_consensus.cc:2396] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260929 11:37:08.745959 17431 leader_election.cc:302] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:08.700558 17391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 284) took 1895 ms. Trace:
I20260929 11:37:08.779498 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bad8c633e7dd41be8d3c15ae27c52240" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.670025 17461 raft_consensus.cc:1261] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260929 11:37:08.746692 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 155759us
I20260929 11:37:08.695825 18651 raft_consensus.cc:482] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:08.793911 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:08.794595 18648 log.cc:924] Time spent T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.136s user 0.000s sys 0.000s
I20260929 11:37:08.794296 18651 raft_consensus.cc:504] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:08.795354 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.792765 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.797195 17309 raft_consensus.cc:2379] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:08.798018 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84d908c031db44039f013807daaa3507" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.798275 17383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59236 (request call id 184) took 5864 ms. Trace:
I20260929 11:37:08.799431 17309 raft_consensus.cc:1226] T 9c9454302f224c02a4a0d6a44ffaf3a0 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:08.798840 17383 rpcz_store.cc:276] 0929 11:37:02.933777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.040340 (+5106563us) service_pool.cc:227] Handling call
0929 11:37:08.053426 (+ 13086us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.758631 (+705205us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.797946 (+ 39315us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54000e6d54. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:08.798181 (+ 235us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1371378944}
I20260929 11:37:08.802250 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.808617 17312 raft_consensus.cc:3037] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.747036 17389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 282) took 2017 ms. Trace:
I20260929 11:37:08.728749 17355 leader_election.cc:302] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
W20260929 11:37:08.810027 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 81397.8us
W20260929 11:37:08.749327 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 158823us
I20260929 11:37:08.691847 18622 leader_election.cc:288] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.810586 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.811075 18622 raft_consensus.cc:482] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:08.666751 18585 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:08.685772 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:08.811553 17309 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.811599 18622 raft_consensus.cc:504] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:08.812520 18016 raft_consensus.cc:2781] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:08.813020 18016 raft_consensus.cc:686] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:08.814008 18622 leader_election.cc:288] T ece37243cd8c44acaf6b92a5deb1274d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:08.813875 18016 consensus_queue.cc:237] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:08.686440 18610 leader_election.cc:288] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.816085 17388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59212 (request call id 257) took 5059 ms. Trace:
I20260929 11:37:08.811765 18585 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.817449 17356 leader_election.cc:302] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:08.816561 17388 rpcz_store.cc:276] 0929 11:37:03.756824 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.382786 (+4625962us) service_pool.cc:227] Handling call
0929 11:37:08.383299 (+ 513us) raft_consensus.cc:1457] Updating replica for 2 ops
0929 11:37:08.499918 (+116619us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.506837 (+ 6919us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0929 11:37:08.555007 (+ 48170us) log.cc:842] Serialized 52 byte log entry
0929 11:37:08.671072 (+116065us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:08.727670 (+ 56598us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.744946 (+ 17276us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:08.815830 (+ 70884us) raft_consensus.cc:1671] finished
0929 11:37:08.815849 (+ 19us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.816025 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8649,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":13600,"thread_start_us":88084,"threads_started":1,"wal-append.queue_time_us":185219}
I20260929 11:37:08.656018 18621 consensus_queue.cc:1035] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260929 11:37:08.691031 17234 raft_consensus.cc:2454] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:08.819435 18624 raft_consensus.cc:2781] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:08.821347 17392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 235) took 5067 ms. Trace:
I20260929 11:37:08.742759 18299 consensus_queue.cc:1046] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260929 11:37:08.727087 18537 raft_consensus.cc:482] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:08.693240 17457 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:08.831362 18537 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.833590 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.834344 17384 raft_consensus.cc:2362] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3. Re-sending same reply.
I20260929 11:37:08.835249 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.776757 17466 raft_consensus.cc:1226] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:08.835930 18585 raft_consensus.cc:504] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.745383 18555 raft_consensus.cc:729] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:08.841887 17458 raft_consensus.cc:1226] T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:08.790688 18611 leader_election.cc:288] T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:08.773196 17315 raft_consensus.cc:2454] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:08.792665 17431 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:08.819959 18624 raft_consensus.cc:686] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:08.793077 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.853042 18624 consensus_queue.cc:237] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:08.853645 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 61072.7us
I20260929 11:37:08.853967 18464 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:08.854384 17431 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:08.778201 17311 raft_consensus.cc:3037] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.856930 18027 raft_consensus.cc:504] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.806093 18651 leader_election.cc:288] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:08.826973 17312 raft_consensus.cc:2454] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 5.
W20260929 11:37:08.787321 18644 log.cc:924] Time spent T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.116s user 0.001s sys 0.000s
I20260929 11:37:08.821740 17392 rpcz_store.cc:276] 0929 11:37:03.753733 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.140282 (+4386549us) service_pool.cc:227] Handling call
0929 11:37:08.140667 (+ 385us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.399423 (+258756us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.399451 (+ 28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:08.399856 (+ 405us) log.cc:842] Serialized 26 byte log entry
0929 11:37:08.498368 (+ 98512us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:08.606980 (+108612us) log.cc:842] Serialized 14 byte log entry
0929 11:37:08.649900 (+ 42920us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.650011 (+ 111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:08.821151 (+171140us) raft_consensus.cc:1671] finished
0929 11:37:08.821169 (+ 18us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.821294 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":172851,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":27982,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":5053,"thread_start_us":222243,"threads_started":3,"wal-append.queue_time_us":155912}
I20260929 11:37:08.746627 18342 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.742573 18616 raft_consensus.cc:504] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.809413 17389 rpcz_store.cc:276] 0929 11:37:06.730062 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.445187 (+1715125us) service_pool.cc:227] Handling call
0929 11:37:08.445490 (+ 303us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.445690 (+ 200us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:08.509212 (+ 63522us) log.cc:842] Serialized 14 byte log entry
0929 11:37:08.746545 (+237333us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:08.746759 (+ 214us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:08.746803 (+ 44us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.746858 (+ 55us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.746986 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6259,"prepare.queue_time_us":136504,"prepare.run_cpu_time_us":7257,"prepare.run_wall_time_us":37027,"raft.queue_time_us":2472,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10865,"thread_start_us":265049,"threads_started":2}
I20260929 11:37:08.681648 18639 raft_consensus.cc:482] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:08.837102 17388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdf4a53492b14021977a532a11216ba2" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.874218 18639 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.873893 18586 consensus_queue.cc:1046] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:08.874920 18586 raft_consensus.cc:3032] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Stepping down as leader of term 4
I20260929 11:37:08.875208 17388 raft_consensus.cc:1203] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Deduplicated request from leader. Original: 0.0->[2.1-2.1] Dedup: 2.1->[]
I20260929 11:37:08.875862 17388 raft_consensus.cc:1226] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260929 11:37:08.836057 17384 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:08.837273 18299 raft_consensus.cc:3032] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Stepping down as leader of term 2
I20260929 11:37:08.875260 18586 raft_consensus.cc:729] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:08.878443 17431 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
W20260929 11:37:08.844017 17413 debug-util.cc:398] Leaking SignalData structure 0x7b080024ea00 after lost signal to thread 17416
I20260929 11:37:08.845187 18634 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.879462 18586 consensus_queue.cc:260] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:37:08.880548 17413 debug-util.cc:398] Leaking SignalData structure 0x7b0800056be0 after lost signal to thread 17490
I20260929 11:37:08.880753 18586 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.881040 18634 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.842696 18555 consensus_queue.cc:260] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.882266 18555 raft_consensus.cc:3037] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af [term 1 FOLLOWER]: Advancing to term 2
I20260929 11:37:08.884128 18342 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.848601 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.878463 18299 raft_consensus.cc:729] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:08.849387 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.885640 17465 raft_consensus.cc:3037] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.885380 18299 consensus_queue.cc:260] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.886610 18299 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.887650 18616 leader_election.cc:288] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Requested vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:08.849684 18631 leader_election.cc:288] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:08.850147 17461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.888860 17461 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.850843 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:08.889638 17386 raft_consensus.cc:2354] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5.
I20260929 11:37:08.890892 17386 raft_consensus.cc:1261] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:08.868135 17282 leader_election.cc:302] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:08.851962 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.853338 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.793318 18463 raft_consensus.cc:2781] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:08.891620 17387 raft_consensus.cc:2454] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 2.
I20260929 11:37:08.892047 18463 raft_consensus.cc:482] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:08.892586 18463 raft_consensus.cc:3037] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.892750 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.893599 17315 raft_consensus.cc:2379] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:08.894335 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.895438 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.854434 18464 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:08.779843 17391 rpcz_store.cc:276] 0929 11:37:06.805290 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.472818 (+1667528us) service_pool.cc:227] Handling call
0929 11:37:08.473163 (+ 345us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.514866 (+ 41703us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.514899 (+ 33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:08.515357 (+ 458us) log.cc:842] Serialized 26 byte log entry
0929 11:37:08.593962 (+ 78605us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:08.594007 (+ 45us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.594083 (+ 76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:08.700240 (+106157us) raft_consensus.cc:1671] finished
0929 11:37:08.700268 (+ 28us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:08.700485 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31961,"raft.queue_time_us":32716,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":8034,"spinlock_wait_cycles":2816,"thread_start_us":55426,"threads_started":1,"wal-append.queue_time_us":170786}
I20260929 11:37:08.792945 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:08.850725 18662 consensus_queue.cc:1035] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:08.734133 17313 raft_consensus.cc:2454] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:08.858992 18027 leader_election.cc:288] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.871137 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:08.896543 18464 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.909772 17389 raft_consensus.cc:2379] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:08.860638 18635 raft_consensus.cc:2781] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:08.857983 17309 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:08.873904 17464 raft_consensus.cc:1226] T 930114cd75514fedbbd5bdfe525080f4 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:08.839078 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.860927 18452 consensus_queue.cc:1046] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260929 11:37:08.915621 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 428246us
I20260929 11:37:08.871083 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.739924 17310 raft_consensus.cc:3037] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:08.897349 17318 raft_consensus.cc:2454] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
W20260929 11:37:08.898140 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 309365us
I20260929 11:37:08.901440 17282 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:08.913817 17313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f710cc4eabc43cb9d15d956a7d405ec" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.917687 17312 raft_consensus.cc:2379] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:08.918778 17355 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:08.940713 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:08.941030 17208 leader_election.cc:302] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:08.941234 17355 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:08.943254 17355 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:08.860172 18613 raft_consensus.cc:2726] T 7e3002f11c7a4c27b73e9842ce11ee63 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:08.909344 17385 raft_consensus.cc:3037] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:08.952155 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 50787.5us
I20260929 11:37:08.952927 17282 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:08.953742 18668 raft_consensus.cc:2781] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:08.954239 18668 raft_consensus.cc:686] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:08.955302 17465 raft_consensus.cc:2454] T fdcbe5836ce94afda8b5e9d3a662ca76 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:08.955084 18668 consensus_queue.cc:237] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.956395 18443 raft_consensus.cc:2726] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:08.956528 18631 raft_consensus.cc:2726] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:08.956634 18452 raft_consensus.cc:3032] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Stepping down as leader of term 4
I20260929 11:37:08.957159 18452 raft_consensus.cc:729] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:08.957677 17208 leader_election.cc:302] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:08.957937 18452 consensus_queue.cc:260] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:08.958762 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 386598us
I20260929 11:37:08.959273 18452 raft_consensus.cc:3037] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.960624 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af63fc2fec1c4842a27dea066965a988" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.961278 17315 raft_consensus.cc:2362] T af63fc2fec1c4842a27dea066965a988 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 5. Re-sending same reply.
I20260929 11:37:08.946354 18355 consensus_queue.cc:1035] T a1525efb73cb41699f311d353ec85272 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260929 11:37:08.961704 17282 leader_election.cc:398] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Vote denied by peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599) with higher term. Message: Invalid argument: T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4.
I20260929 11:37:08.962060 17282 leader_election.cc:401] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260929 11:37:08.962239 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:08.962744 18620 raft_consensus.cc:504] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.963492 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.964226 18027 raft_consensus.cc:2726] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599) with higher term. Message: Invalid argument: T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4.
I20260929 11:37:08.964793 18620 leader_election.cc:288] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.944797 18623 raft_consensus.cc:2726] T 84d908c031db44039f013807daaa3507 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:08.965723 18620 consensus_queue.cc:1046] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260929 11:37:08.965842 18537 raft_consensus.cc:504] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.966894 18197 raft_consensus.cc:3032] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:08.967238 18197 raft_consensus.cc:729] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:08.968120 18197 consensus_queue.cc:260] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:08.969254 18585 leader_election.cc:288] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:08.969821 18197 raft_consensus.cc:3037] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:08.916201 18635 raft_consensus.cc:482] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:08.969903 18639 raft_consensus.cc:504] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:08.970506 18635 raft_consensus.cc:3037] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.971920 18639 leader_election.cc:288] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:08.972100 17384 raft_consensus.cc:1226] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [term 4 LEADER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260929 11:37:08.973994 17466 raft_consensus.cc:1226] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:08.975742 18342 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:08.976152 18342 raft_consensus.cc:482] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:08.976498 18342 raft_consensus.cc:3037] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:08.976805 17282 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:08.977541 18620 raft_consensus.cc:2781] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:08.978016 18620 raft_consensus.cc:686] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:08.978180 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.978986 17234 raft_consensus.cc:2379] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:08.947310 18574 raft_consensus.cc:2726] T ece37243cd8c44acaf6b92a5deb1274d P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260929 11:37:08.978926 18620 consensus_queue.cc:237] T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:08.912225 18651 raft_consensus.cc:2781] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:08.980054 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:08.980858 17237 raft_consensus.cc:2362] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 5. Re-sending same reply.
I20260929 11:37:08.981508 17389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:08.981738 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:08.982254 17235 raft_consensus.cc:2362] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2. Re-sending same reply.
I20260929 11:37:08.982672 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:08.983124 17241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:08.984222 17462 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:08.977418 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:08.987144 17240 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:08.983670 17241 raft_consensus.cc:2362] T 3c629677b9d54b97a292b8e5388288eb P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 5. Re-sending same reply.
I20260929 11:37:08.990897 17356 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:08.990981 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:08.950014 17355 leader_election.cc:302] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:08.993440 17391 raft_consensus.cc:2379] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:08.941574 17459 raft_consensus.cc:1226] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:08.967790 18537 leader_election.cc:288] T 8b65856aeb514b6e9688762800e2e9fb P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:37:08.998400 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 48517.6us
I20260929 11:37:08.985149 17315 raft_consensus.cc:2379] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 5: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:09.003652 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.006119 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:09.007011 17206 leader_election.cc:302] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:09.007412 17317 raft_consensus.cc:2454] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 2.
I20260929 11:37:09.011894 17388 raft_consensus.cc:1226] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: []
I20260929 11:37:09.012732 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:09.027848 17242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
W20260929 11:37:09.011320 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 114809us
I20260929 11:37:09.029556 17431 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:09.031656 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:09.034304 17429 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:09.028688 17242 raft_consensus.cc:2454] T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 5.
I20260929 11:37:08.983681 18651 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:09.011816 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cfcf62331b042cb8ddc12c582c2d62c" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:09.037700 17429 leader_election.cc:302] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:09.053468 17465 raft_consensus.cc:1226] T 3d5e6ddd0e1143509bc667ce0d157fca P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:09.048681 17311 raft_consensus.cc:2454] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:09.054806 18537 raft_consensus.cc:2781] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:09.055393 18537 raft_consensus.cc:686] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:09.055712 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:09.055583 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59afcac98ed94a53805eab1321f05fea" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.056263 18537 consensus_queue.cc:237] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:09.056859 17311 raft_consensus.cc:2354] T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5.
I20260929 11:37:09.057873 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df496b2ead6419983ffed1627fb69f9" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.057933 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.058270 18522 raft_consensus.cc:2781] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:09.058729 17315 raft_consensus.cc:2379] T 1df496b2ead6419983ffed1627fb69f9 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:09.058759 18522 raft_consensus.cc:482] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:09.049464 18530 raft_consensus.cc:2726] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:09.059369 18522 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.059676 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:09.059988 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 102426us
I20260929 11:37:09.060428 18651 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.067909 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9454302f224c02a4a0d6a44ffaf3a0" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:09.049093 18639 raft_consensus.cc:2781] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:09.068858 17387 raft_consensus.cc:3037] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.069123 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:09.071445 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8232a146a4ae4a84b9292eab399fd1cb" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
W20260929 11:37:09.050447 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 43509.5us
I20260929 11:37:09.072301 17383 raft_consensus.cc:2379] T 8232a146a4ae4a84b9292eab399fd1cb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:09.072950 17206 leader_election.cc:302] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:09.073151 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c712464fc6c4fb7b3b479dd59774f1a" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:09.074118 17206 leader_election.cc:398] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795) with higher term. Message: Invalid argument: T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5.
I20260929 11:37:09.074430 17206 leader_election.cc:401] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260929 11:37:09.074345 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1468df1420664db9972432b0042a2488" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:09.075040 17383 raft_consensus.cc:2454] T 1468df1420664db9972432b0042a2488 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:09.075139 18574 raft_consensus.cc:2781] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:09.075634 18574 raft_consensus.cc:686] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:09.075946 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d04716ced464bc8b01430636a571cdd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:09.076678 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.076507 18574 consensus_queue.cc:237] T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.001133 18613 consensus_queue.cc:1046] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260929 11:37:09.012410 18355 raft_consensus.cc:2781] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:09.004416 18623 raft_consensus.cc:2781] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:09.081346 18655 raft_consensus.cc:2726] T 59afcac98ed94a53805eab1321f05fea P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795) with higher term. Message: Invalid argument: T 59afcac98ed94a53805eab1321f05fea P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5.
I20260929 11:37:09.068872 18639 raft_consensus.cc:482] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:09.005560 18649 raft_consensus.cc:686] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [term 4 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
W20260929 11:37:09.085309 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 99650.7us
I20260929 11:37:09.085090 18585 raft_consensus.cc:2726] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:09.085990 17208 leader_election.cc:302] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:09.122921 17392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791cc703ef754cb5a68316bbc895a05d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:08.994280 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:08.995014 17461 raft_consensus.cc:2454] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:09.096086 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d5e6ddd0e1143509bc667ce0d157fca" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:09.029163 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2303ddc899e94157b6c5ad7185a7a9bc" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.097201 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:09.098593 17466 raft_consensus.cc:1226] T 96828e8ec02b4abe91b7c6328a84d114 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:09.095403 18355 raft_consensus.cc:686] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:09.095525 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:09.108423 17312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:37:09.120751 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 116155us
I20260929 11:37:09.100636 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a01f47e3bb47bea991cd4475dfb89f" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:09.177594 17312 raft_consensus.cc:3037] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:09.177908 17317 raft_consensus.cc:3037] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.178511 17283 leader_election.cc:302] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:09.179373 18670 raft_consensus.cc:2781] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:09.179795 18670 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:09.127085 17357 leader_election.cc:302] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:09.180783 18624 raft_consensus.cc:2781] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
W20260929 11:37:09.180891 17357 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 53895.4us
I20260929 11:37:09.181308 18624 raft_consensus.cc:686] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:09.182196 18624 consensus_queue.cc:237] T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:09.183161 17243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eaaf8a15b5b4aa3ac199ce1509f3110" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:09.126312 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ece37243cd8c44acaf6b92a5deb1274d" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:09.184588 17282 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:09.085213 17355 leader_election.cc:302] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:09.185299 18197 raft_consensus.cc:2781] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election won for term 3
W20260929 11:37:09.185526 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 100446us
I20260929 11:37:09.091823 18623 raft_consensus.cc:482] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:09.186053 18660 raft_consensus.cc:2781] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:09.186391 18623 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.186488 17239 raft_consensus.cc:3032] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:09.186591 18660 raft_consensus.cc:686] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [term 4 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:09.186940 17239 raft_consensus.cc:729] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:09.187651 17239 consensus_queue.cc:260] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:09.136780 17206 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:09.188633 18197 raft_consensus.cc:686] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Leader. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
W20260929 11:37:09.188874 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 52174.3us
I20260929 11:37:09.090198 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c1a5e3d37784c8c866702270fbb2ca6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.190048 17315 raft_consensus.cc:2454] T 0c1a5e3d37784c8c866702270fbb2ca6 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 5.
I20260929 11:37:09.190251 18665 raft_consensus.cc:2726] T 2303ddc899e94157b6c5ad7185a7a9bc P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260929 11:37:09.189594 18197 consensus_queue.cc:237] T 7466b008788c41588274cefe10e78185 P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.191104 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.100925 18639 raft_consensus.cc:3037] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:09.193241 17429 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:09.102015 17386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c629677b9d54b97a292b8e5388288eb" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:09.195305 17386 raft_consensus.cc:2379] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 5: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:09.096280 18616 raft_consensus.cc:3032] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:09.197281 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376551ad71d48f9b08315025561869e" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:09.180131 18670 raft_consensus.cc:3037] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:09.185665 17317 raft_consensus.cc:2454] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 5.
I20260929 11:37:09.187551 18660 consensus_queue.cc:237] T ef0ba93c758b44c68b9eebc4712f42cd P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:09.138043 17431 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:09.196055 18616 raft_consensus.cc:729] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:09.205807 17429 leader_election.cc:302] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:09.207855 17239 raft_consensus.cc:3037] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:09.093987 17383 raft_consensus.cc:2454] T 9d04716ced464bc8b01430636a571cdd P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 2.
I20260929 11:37:09.093235 18668 consensus_queue.cc:1046] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260929 11:37:09.134610 18275 raft_consensus.cc:2741] T 7466b008788c41588274cefe10e78185 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260929 11:37:09.202905 17189 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260929 11:37:09.209573 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef0ba93c758b44c68b9eebc4712f42cd" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:09.214126 17317 raft_consensus.cc:2379] T ef0ba93c758b44c68b9eebc4712f42cd P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate bb8e3505668b40219823840c0d8bc3af in this term.
I20260929 11:37:09.214953 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6520b46bbc094c889371e9c2ff6748bd" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.038017 18463 raft_consensus.cc:504] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.216056 17318 raft_consensus.cc:2379] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 4: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
W20260929 11:37:09.219631 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 133674us
I20260929 11:37:09.221067 17208 leader_election.cc:302] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:09.222771 18530 raft_consensus.cc:2726] T 8b65856aeb514b6e9688762800e2e9fb P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:37:09.223107 17208 leader_election.cc:398] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Vote denied by peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835) with higher term. Message: Invalid argument: T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:37:09.223559 17208 leader_election.cc:401] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260929 11:37:09.227185 17239 raft_consensus.cc:1261] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260929 11:37:09.227787 17239 pending_rounds.cc:76] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573: Aborting all ops after (but not including) 1
I20260929 11:37:09.228068 17239 pending_rounds.cc:97] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260929 11:37:09.228412 17239 raft_consensus.cc:2866] T 75a68f6896d44d2ca026dcb8e903d1c9 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:37:09.196877 18655 raft_consensus.cc:2781] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260929 11:37:09.228677 17312 raft_consensus.cc:2454] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 4.
I20260929 11:37:09.174814 17311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e2488d0f744f5913ac947362f1e27" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:09.224359 18530 raft_consensus.cc:2726] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835) with higher term. Message: Invalid argument: T 35275d14d1b4485fbb03887df828daa2 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3.
I20260929 11:37:09.256515 17206 leader_election.cc:302] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters:
I20260929 11:37:09.256935 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40ff2f2b6de34730a98257133e3882a4" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.258150 17318 raft_consensus.cc:2379] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 013a37bea2eb40c0ad4ce8f296176573 in current term 5: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:09.230784 17283 leader_election.cc:302] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:09.260249 18634 raft_consensus.cc:2781] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:09.260908 18634 raft_consensus.cc:482] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:09.260102 18616 consensus_queue.cc:260] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:09.261310 18634 raft_consensus.cc:3037] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.175288 18621 consensus_queue.cc:1046] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260929 11:37:09.229635 17242 pending_rounds.cc:76] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573: Aborting all ops after (but not including) 0
I20260929 11:37:09.308657 17242 pending_rounds.cc:97] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260929 11:37:09.206564 18586 raft_consensus.cc:2781] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260929 11:37:09.199045 17315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.126238 18342 raft_consensus.cc:504] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.308034 17314 raft_consensus.cc:1226] T 40ff2f2b6de34730a98257133e3882a4 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:09.308982 17242 raft_consensus.cc:2866] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260929 11:37:09.333317 17239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:09.270015 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
W20260929 11:37:09.328280 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 109270us
W20260929 11:37:09.330936 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 85485.6us
I20260929 11:37:09.356488 17283 leader_election.cc:302] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:09.356055 17239 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 4.
I20260929 11:37:09.357259 17312 raft_consensus.cc:1226] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:09.358577 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dda74a7e6ff64812814139f0aedd4baf" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:09.272502 17460 raft_consensus.cc:1226] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:09.357314 17317 raft_consensus.cc:2454] T a1525efb73cb41699f311d353ec85272 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 013a37bea2eb40c0ad4ce8f296176573 in term 3.
I20260929 11:37:09.271442 18463 leader_election.cc:288] T dda74a7e6ff64812814139f0aedd4baf P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:09.279482 17234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdcbe5836ce94afda8b5e9d3a662ca76" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:09.269210 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1525efb73cb41699f311d353ec85272" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:09.210476 17457 raft_consensus.cc:2379] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bb8e3505668b40219823840c0d8bc3af in current term 3: Already voted for candidate a7e500c82a21469ab59f66205205a12a in this term.
I20260929 11:37:09.204207 17237 raft_consensus.cc:3037] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
I20260929 11:37:09.265005 17311 raft_consensus.cc:2362] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 5. Re-sending same reply.
I20260929 11:37:09.330278 18586 raft_consensus.cc:482] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:09.412037 17318 raft_consensus.cc:1226] T 95a01f47e3bb47bea991cd4475dfb89f P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260929 11:37:09.368216 17283 leader_election.cc:302] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 013a37bea2eb40c0ad4ce8f296176573
I20260929 11:37:09.331235 18530 raft_consensus.cc:2781] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:09.264283 17310 raft_consensus.cc:2454] T cb100fbaa5d4434c9b62299d39e52992 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 3.
I20260929 11:37:09.270677 17385 raft_consensus.cc:2454] T 791cc703ef754cb5a68316bbc895a05d P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 4.
I20260929 11:37:09.370630 18621 raft_consensus.cc:3032] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
W20260929 11:37:09.379906 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.193:35361, user_credentials={real_user=slave}} blocked reactor thread for 243548us
I20260929 11:37:09.276898 18649 consensus_queue.cc:237] T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.381642 18463 consensus_queue.cc:1046] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260929 11:37:09.382180 18631 raft_consensus.cc:3032] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:09.382997 17234 raft_consensus.cc:2379] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7e500c82a21469ab59f66205205a12a in current term 3: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:09.388496 18443 consensus_queue.cc:1035] T 75a68f6896d44d2ca026dcb8e903d1c9 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260929 11:37:09.267814 18651 raft_consensus.cc:504] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:09.239267 18585 raft_consensus.cc:2781] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:09.359053 18655 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260929 11:37:09.264771 17387 raft_consensus.cc:2454] T 9c9454302f224c02a4a0d6a44ffaf3a0 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 5.
I20260929 11:37:09.412955 17239 raft_consensus.cc:1261] T db3516ecd8394495878d2f749d8fa27d P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260929 11:37:09.418270 17312 raft_consensus.cc:1226] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260929 11:37:09.268136 18659 log.cc:924] Time spent T ef22bce609f94dd4b4c3f039c01e473e P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.168s user 0.001s sys 0.001s
I20260929 11:37:09.427834 17356 leader_election.cc:302] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:09.378777 18623 raft_consensus.cc:504] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:09.367761 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5714036d5174aaf8365d9e64517c5e0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.379168 18027 raft_consensus.cc:2781] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:09.439718 17355 leader_election.cc:302] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
I20260929 11:37:09.438536 18631 raft_consensus.cc:729] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7e500c82a21469ab59f66205205a12a, State: Running, Role: LEADER
I20260929 11:37:09.480772 18655 raft_consensus.cc:3037] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:09.490032 18464 consensus_meta.cc:287] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.548s user 0.003s sys 0.006s
I20260929 11:37:09.268036 18355 consensus_queue.cc:237] T 59afcac98ed94a53805eab1321f05fea P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:09.469812 17318 raft_consensus.cc:1261] T db3516ecd8394495878d2f749d8fa27d P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260929 11:37:09.429522 18530 raft_consensus.cc:686] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Leader. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:09.431128 18621 raft_consensus.cc:729] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
W20260929 11:37:09.500916 17356 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 73192.9us
I20260929 11:37:09.388783 18667 consensus_queue.cc:1046] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260929 11:37:09.502417 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 246006us
I20260929 11:37:09.514029 17312 raft_consensus.cc:1226] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer bb8e3505668b40219823840c0d8bc3af for earlier term 3. Current term is 4. Ops: []
W20260929 11:37:09.513968 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 74376.5us
I20260929 11:37:09.543237 17385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:09.545207 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b191832c71294d9c9c742c66bd25c2b6" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af" is_pre_election: true
I20260929 11:37:09.546655 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35275d14d1b4485fbb03887df828daa2" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:09.503394 18027 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
W20260929 11:37:09.513938 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 261337us
I20260929 11:37:09.518193 17239 raft_consensus.cc:1261] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260929 11:37:09.521416 18666 raft_consensus.cc:2781] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election won for term 3
I20260929 11:37:09.556931 17206 leader_election.cc:302] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, a7e500c82a21469ab59f66205205a12a; no voters: bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:09.559231 17391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b65856aeb514b6e9688762800e2e9fb" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:09.565634 18670 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:09.567855 18670 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:09.568634 17317 raft_consensus.cc:1226] T c2fa1c2d5ef24a278619dbf6b3a135ab P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:09.512907 18307 consensus_queue.cc:1035] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260929 11:37:09.490056 18585 raft_consensus.cc:686] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:09.416751 18586 raft_consensus.cc:3037] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Advancing to term 6
I20260929 11:37:09.517544 18660 raft_consensus.cc:2726] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260929 11:37:09.553562 18677 log.cc:924] Time spent T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.113s user 0.000s sys 0.000s
I20260929 11:37:09.553737 18651 leader_election.cc:288] T a69cd2eecec44c94912facf79cbb066e P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
W20260929 11:37:09.529629 18635 consensus_meta.cc:287] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.559s user 0.003s sys 0.007s
I20260929 11:37:09.554919 17309 raft_consensus.cc:2379] T c5714036d5174aaf8365d9e64517c5e0 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 in current term 4: Already voted for candidate 013a37bea2eb40c0ad4ce8f296176573 in this term.
I20260929 11:37:09.578691 17429 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a; no voters:
W20260929 11:37:09.528852 17431 leader_election.cc:334] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 1.501s (SENT)
I20260929 11:37:09.536767 18522 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.560999 17310 raft_consensus.cc:1261] T 9d04716ced464bc8b01430636a571cdd P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260929 11:37:09.560423 18027 raft_consensus.cc:3037] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.527981 18464 raft_consensus.cc:504] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.530824 18639 raft_consensus.cc:504] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.573356 17311 raft_consensus.cc:1261] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer 013a37bea2eb40c0ad4ce8f296176573: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:09.669124 17459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a69cd2eecec44c94912facf79cbb066e" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:09.669657 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:09.584623 18448 consensus_queue.cc:1035] T ac8d7cf3a0d84804ad52464db2fb53ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.281s
I20260929 11:37:09.585897 17318 raft_consensus.cc:1261] T 6108e0155a134589a2d418b9fedbe6ca P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:09.583681 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "a7e500c82a21469ab59f66205205a12a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
W20260929 11:37:09.677565 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 180577us
I20260929 11:37:09.903609 17207 leader_election.cc:302] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
W20260929 11:37:09.828744 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 271920us
W20260929 11:37:09.680725 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 102122us
I20260929 11:37:09.642397 18620 raft_consensus.cc:2781] T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:09.859622 17384 raft_consensus.cc:2354] T b191832c71294d9c9c742c66bd25c2b6 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 2. Current term is 3.
I20260929 11:37:09.677800 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7466b008788c41588274cefe10e78185" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:09.586404 18342 leader_election.cc:288] T 27f6e0507d9c4264842d9efd8606b256 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:09.613572 17387 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3002f11c7a4c27b73e9842ce11ee63" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
W20260929 11:37:09.876070 18669 log.cc:924] Time spent T 9c712464fc6c4fb7b3b479dd59774f1a P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.242s user 0.001s sys 0.000s
W20260929 11:37:09.878296 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 349454us
I20260929 11:37:09.574775 18616 raft_consensus.cc:3037] T 8b65856aeb514b6e9688762800e2e9fb P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
W20260929 11:37:09.860973 18679 log.cc:924] Time spent T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.521s user 0.000s sys 0.001s
I20260929 11:37:09.641973 17390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59224 (request call id 245) took 4904 ms. Trace:
I20260929 11:37:09.918500 17317 raft_consensus.cc:1226] T 6520b46bbc094c889371e9c2ff6748bd P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Rejecting Update request from peer 26cd298fcaa34c9f93d8793e64f0e863 for earlier term 3. Current term is 4. Ops: []
W20260929 11:37:09.900372 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 532178us
I20260929 11:37:09.861122 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48786 (request call id 282) took 1030 ms. Trace:
I20260929 11:37:09.908478 17318 raft_consensus.cc:1261] T 791cc703ef754cb5a68316bbc895a05d P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Refusing update from remote peer 26cd298fcaa34c9f93d8793e64f0e863: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260929 11:37:09.912024 17207 leader_election.cc:302] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:09.925873 17207 leader_election.cc:302] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:09.927300 17207 leader_election.cc:302] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
W20260929 11:37:09.911041 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 296231us
I20260929 11:37:09.865334 17383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96828e8ec02b4abe91b7c6328a84d114" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bb8e3505668b40219823840c0d8bc3af"
I20260929 11:37:09.866755 18624 consensus_queue.cc:1035] T db3516ecd8394495878d2f749d8fa27d P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260929 11:37:09.676580 18635 raft_consensus.cc:504] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.917852 17311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 276) took 1068 ms. Trace:
I20260929 11:37:09.902228 18660 raft_consensus.cc:482] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:09.577769 18631 consensus_queue.cc:260] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.876544 18662 raft_consensus.cc:482] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 26cd298fcaa34c9f93d8793e64f0e863)
I20260929 11:37:09.904594 18651 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:09.929759 17235 raft_consensus.cc:3032] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Stepping down as leader of term 4
I20260929 11:37:10.002251 17235 raft_consensus.cc:729] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:09.912024 18537 consensus_queue.cc:1046] T 40ff2f2b6de34730a98257133e3882a4 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260929 11:37:09.958248 17283 leader_election.cc:302] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:09.907658 17459 raft_consensus.cc:3037] T a69cd2eecec44c94912facf79cbb066e P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.971783 17462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863"
I20260929 11:37:10.014103 17462 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Advancing to term 5
I20260929 11:37:09.907222 17310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 278) took 1060 ms. Trace:
I20260929 11:37:10.003080 17235 consensus_queue.cc:260] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:09.909662 18686 consensus_queue.cc:1046] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.095s
I20260929 11:37:09.918138 17457 raft_consensus.cc:1261] T b191832c71294d9c9c742c66bd25c2b6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer a7e500c82a21469ab59f66205205a12a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:09.866592 18666 raft_consensus.cc:686] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
W20260929 11:37:09.971221 18555 consensus_meta.cc:287] T ec0779c5ab5f4982ac77456eafc8a9e7 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 1.089s user 0.009s sys 0.003s
I20260929 11:37:09.867714 18530 consensus_queue.cc:237] T c5714036d5174aaf8365d9e64517c5e0 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:09.918421 17390 rpcz_store.cc:276] 0929 11:37:04.719189 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.419698 (+3700509us) service_pool.cc:227] Handling call
0929 11:37:08.420154 (+ 456us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:08.475304 (+ 55150us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:08.475361 (+ 57us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:08.488782 (+ 13421us) log.cc:842] Serialized 26 byte log entry
0929 11:37:08.761985 (+273203us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:08.762023 (+ 38us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:08.762091 (+ 68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:09.267757 (+505666us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b24004cf6b8. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b67b0f11 00007f79b67c4cf4 00007f79b67c2dfb 00007f79b6851559 00007f79b68511e5 00007f79b685082d 00007f79b94ff46e 00007f79b9516c0c 00007f79b9515f36 00007f79b9515b58 00007f79b951f551
0929 11:37:09.584744 (+316987us) raft_consensus.cc:1671] finished
0929 11:37:09.584776 (+ 32us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:09.623466 (+ 38690us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54705,"raft.queue_time_us":55383,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":3575,"spinlock_wait_cycles":63445888,"thread_start_us":247355,"threads_started":1,"wal-append.queue_time_us":529908}
I20260929 11:37:09.928965 17309 rpcz_store.cc:276] 0929 11:37:08.805898 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:09.278502 (+472604us) service_pool.cc:227] Handling call
0929 11:37:09.836165 (+557663us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:10.004676 17463 raft_consensus.cc:1226] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 4. Current term is 5. Ops: []
I20260929 11:37:09.922122 18463 consensus_queue.cc:1046] T c2fa1c2d5ef24a278619dbf6b3a135ab P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
W20260929 11:37:10.016192 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 58200.9us
I20260929 11:37:10.037204 17283 leader_election.cc:302] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 013a37bea2eb40c0ad4ce8f296176573, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:09.998453 18623 leader_election.cc:288] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
W20260929 11:37:09.912925 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 335969us
I20260929 11:37:10.040879 17465 raft_consensus.cc:1226] T c376551ad71d48f9b08315025561869e P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Rejecting Update request from peer a7e500c82a21469ab59f66205205a12a for earlier term 3. Current term is 4. Ops: []
I20260929 11:37:09.923826 18443 raft_consensus.cc:482] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:10.024971 17240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47704 (request call id 304) took 1035 ms. Trace:
I20260929 11:37:10.016294 17208 leader_election.cc:302] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:10.037954 17464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56174 (request call id 391) took 1069 ms. Trace:
W20260929 11:37:10.019057 17206 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 110563us
W20260929 11:37:10.036113 17429 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 72163.9us
I20260929 11:37:09.911736 18585 consensus_queue.cc:237] T 95a01f47e3bb47bea991cd4475dfb89f P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:10.044836 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 117640us
I20260929 11:37:10.063366 17462 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:10.064267 17207 leader_election.cc:302] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:10.057682 17464 rpcz_store.cc:276] 0929 11:37:08.968915 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.985292 (+ 16377us) service_pool.cc:227] Handling call
0929 11:37:09.027798 (+ 42506us) raft_consensus.cc:1457] Updating replica for 1 ops
0929 11:37:09.028157 (+ 359us) raft_consensus.cc:1520] Early marking committed up to index 0
0929 11:37:09.028183 (+ 26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0929 11:37:09.088183 (+ 60000us) log.cc:842] Serialized 26 byte log entry
0929 11:37:09.139683 (+ 51500us) raft_consensus.cc:1631] Marking committed up to 1
0929 11:37:09.139737 (+ 54us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:09.139830 (+ 93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0929 11:37:10.037745 (+897915us) raft_consensus.cc:1671] finished
0929 11:37:10.037767 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:10.037900 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":18641,"thread_start_us":14432,"threads_started":1,"wal-append.queue_time_us":120243}
I20260929 11:37:10.000082 18660 raft_consensus.cc:504] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:10.057449 17240 rpcz_store.cc:276] 0929 11:37:08.989469 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.990002 (+ 533us) service_pool.cc:227] Handling call
0929 11:37:09.012137 (+ 22135us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:09.036278 (+ 24141us) raft_consensus.cc:1520] Early marking committed up to index 2
0929 11:37:09.309012 (+272734us) log.cc:842] Serialized 14 byte log entry
0929 11:37:10.024711 (+715699us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:10.024759 (+ 48us) raft_consensus.cc:1631] Marking committed up to 2
0929 11:37:10.024788 (+ 29us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:10.024835 (+ 47us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:10.024924 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":218543,"prepare.queue_time_us":82561,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":21915,"raft.queue_time_us":288447,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8781,"thread_start_us":726144,"threads_started":3}
I20260929 11:37:09.987843 17311 rpcz_store.cc:276] 0929 11:37:08.846492 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:09.435315 (+588823us) service_pool.cc:227] Handling call
0929 11:37:09.516543 (+ 81228us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:09.899610 (+383067us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:09.915124 (+ 15514us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:09.975884 18684 consensus_queue.cc:1035] T 27f6e0507d9c4264842d9efd8606b256 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260929 11:37:10.069133 18443 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:10.075001 18708 consensus_queue.cc:1046] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260929 11:37:10.013577 18651 raft_consensus.cc:504] T 5ac14169d0374d3ea61e619a1488a6f7 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:10.039019 18683 raft_consensus.cc:2781] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:10.098255 17235 raft_consensus.cc:3037] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:10.004580 18662 raft_consensus.cc:504] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:10.096228 18027 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
W20260929 11:37:10.078716 18705 log.cc:924] Time spent T 9c712464fc6c4fb7b3b479dd59774f1a P bb8e3505668b40219823840c0d8bc3af: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260929 11:37:10.102941 17356 leader_election.cc:302] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters:
I20260929 11:37:10.065796 18624 raft_consensus.cc:482] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:10.065559 18686 raft_consensus.cc:2726] T 0c1a5e3d37784c8c866702270fbb2ca6 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260929 11:37:10.085165 18715 log.cc:924] Time spent T af63fc2fec1c4842a27dea066965a988 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
W20260929 11:37:10.079831 18700 log.cc:924] Time spent T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260929 11:37:10.115500 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81a2704a8866420f844ab5f310c1e894" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573"
I20260929 11:37:10.127756 17240 raft_consensus.cc:3037] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:10.117374 18027 leader_election.cc:288] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835)
I20260929 11:37:10.016680 17310 rpcz_store.cc:276] 0929 11:37:08.846980 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:09.443754 (+596774us) service_pool.cc:227] Handling call
0929 11:37:09.503983 (+ 60229us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:09.867094 (+363111us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:09.905127 (+ 38033us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260929 11:37:10.120106 17315 raft_consensus.cc:1226] T 8c68e526f10e41d28e5d99b4d239f940 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Rejecting Update request from peer 013a37bea2eb40c0ad4ce8f296176573 for earlier term 4. Current term is 5. Ops: []
W20260929 11:37:10.127401 17355 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.194:35795, user_credentials={real_user=slave}} blocked reactor thread for 51598.6us
W20260929 11:37:10.119369 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 203259us
I20260929 11:37:10.078779 18712 raft_consensus.cc:2781] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:10.077827 18706 raft_consensus.cc:2726] T fdcbe5836ce94afda8b5e9d3a662ca76 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260929 11:37:10.075358 18639 leader_election.cc:288] T 0600a8955396487994f093e8edbd8ac0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:10.128800 18027 raft_consensus.cc:2726] T 99e908ebf22e447487392401adf8bfd8 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260929 11:37:10.080770 18635 leader_election.cc:288] T 66c38ca223cc4337b527ebd9abd29cd5 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:10.098981 18623 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:10.130703 18704 raft_consensus.cc:482] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:10.131158 17316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48776 (request call id 325) took 1638 ms. Trace:
I20260929 11:37:10.131263 18668 raft_consensus.cc:2726] T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260929 11:37:10.103410 18522 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 election: Requested vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:10.083213 18660 leader_election.cc:288] T 119bbba610844188b3191eb62136fae2 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:10.140648 18027 consensus_queue.cc:1046] T c376551ad71d48f9b08315025561869e P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260929 11:37:10.150962 17431 leader_election.cc:334] T 9c9454302f224c02a4a0d6a44ffaf3a0 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835): Timed out: RequestConsensusVote RPC to 127.13.221.195:33835 timed out after 2.106s (SENT)
I20260929 11:37:10.103665 18693 raft_consensus.cc:2726] T 6e1e2488d0f744f5913ac947362f1e27 P a7e500c82a21469ab59f66205205a12a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:10.120517 18464 leader_election.cc:288] T af251f3277b7413d8197acd312513289 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 election: Requested vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:10.127337 18448 raft_consensus.cc:482] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 013a37bea2eb40c0ad4ce8f296176573)
I20260929 11:37:10.107100 18016 consensus_queue.cc:1046] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260929 11:37:10.132956 17309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0600a8955396487994f093e8edbd8ac0" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:37:10.252841 17312 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s user 0.006s sys 0.011s
W20260929 11:37:10.266597 17312 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s user 0.007s sys 0.011s
W20260929 11:37:10.261193 17239 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.690s user 0.004s sys 0.015s
I20260929 11:37:10.137012 18712 raft_consensus.cc:482] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
I20260929 11:37:10.139760 18686 raft_consensus.cc:482] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:10.268360 17239 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.698s user 0.004s sys 0.015s
W20260929 11:37:10.268826 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 122116us
I20260929 11:37:10.145505 17460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56190 (request call id 291) took 1293 ms. Trace:
W20260929 11:37:10.251344 18452 consensus_meta.cc:287] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 1.284s user 0.011s sys 0.001s
W20260929 11:37:10.298408 17431 connection.cc:232] RPC call timeout handler was delayed by -1.194288940999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260929 11:37:10.299191 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 158191us
W20260929 11:37:10.310071 17431 connection.cc:232] RPC call timeout handler was delayed by -1.0304889409999305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260929 11:37:10.311224 17431 leader_election.cc:302] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:10.311298 17283 leader_election.cc:302] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7e500c82a21469ab59f66205205a12a; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:10.312947 17431 leader_election.cc:302] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:10.314361 17431 leader_election.cc:302] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:10.317757 17235 raft_consensus.cc:1261] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260929 11:37:10.319173 17235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:10.142102 18708 consensus_queue.cc:1046] T 6108e0155a134589a2d418b9fedbe6ca P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260929 11:37:10.251355 18706 raft_consensus.cc:2726] T 66c38ca223cc4337b527ebd9abd29cd5 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:10.133018 18624 raft_consensus.cc:504] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:10.249840 18522 raft_consensus.cc:2726] T ef22bce609f94dd4b4c3f039c01e473e P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260929 11:37:10.145731 18623 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:10.146981 18635 consensus_queue.cc:1046] T 6520b46bbc094c889371e9c2ff6748bd P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.162s
I20260929 11:37:10.262861 17457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119bbba610844188b3191eb62136fae2" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:10.334479 18693 raft_consensus.cc:482] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:10.273250 18712 raft_consensus.cc:3037] T c376551ad71d48f9b08315025561869e P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:10.161422 18639 consensus_queue.cc:1035] T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.160s
I20260929 11:37:10.348498 18717 raft_consensus.cc:3032] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Stepping down as leader of term 4
I20260929 11:37:10.329252 18686 raft_consensus.cc:504] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:10.348935 18697 raft_consensus.cc:2741] T 0600a8955396487994f093e8edbd8ac0 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260929 11:37:10.327893 18307 consensus_queue.cc:1035] T 6108e0155a134589a2d418b9fedbe6ca P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260929 11:37:10.265038 18660 raft_consensus.cc:2781] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Leader election won for term 5
I20260929 11:37:10.319729 17309 raft_consensus.cc:3037] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:10.336584 18299 consensus_meta.cc:287] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af: Time spent flushing consensus metadata: real 1.450s user 0.017s sys 0.006s
I20260929 11:37:10.295872 18574 raft_consensus.cc:2781] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:10.270244 18448 raft_consensus.cc:504] T 8c68e526f10e41d28e5d99b4d239f940 P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:10.352807 18452 raft_consensus.cc:482] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:10.274111 18649 consensus_queue.cc:1035] T b191832c71294d9c9c742c66bd25c2b6 P a7e500c82a21469ab59f66205205a12a [LEADER]: Connected to new peer: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260929 11:37:10.147269 18704 raft_consensus.cc:504] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:10.350208 18687 log.cc:924] Time spent T 791cc703ef754cb5a68316bbc895a05d P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.175s user 0.000s sys 0.001s
I20260929 11:37:10.369273 18016 raft_consensus.cc:3032] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Stepping down as leader of term 3
I20260929 11:37:10.372606 18683 raft_consensus.cc:686] T 6e1e2488d0f744f5913ac947362f1e27 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 LEADER]: Becoming Leader. State: Replica: 26cd298fcaa34c9f93d8793e64f0e863, State: Running, Role: LEADER
I20260929 11:37:10.388827 17457 raft_consensus.cc:2454] T 119bbba610844188b3191eb62136fae2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 2.
I20260929 11:37:10.403419 18709 raft_consensus.cc:482] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:10.388528 18717 raft_consensus.cc:729] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 013a37bea2eb40c0ad4ce8f296176573, State: Running, Role: LEADER
I20260929 11:37:10.403720 18714 raft_consensus.cc:3037] T 1df496b2ead6419983ffed1627fb69f9 P 26cd298fcaa34c9f93d8793e64f0e863 [term 2 FOLLOWER]: Advancing to term 3
W20260929 11:37:10.406173 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 330756us
I20260929 11:37:10.377064 17458 raft_consensus.cc:1261] T ac8d7cf3a0d84804ad52464db2fb53ca P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260929 11:37:10.420957 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 415388us
I20260929 11:37:10.316895 17460 rpcz_store.cc:276] 0929 11:37:08.849079 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.850075 (+ 996us) service_pool.cc:227] Handling call
0929 11:37:08.850383 (+ 308us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:09.365004 (+514621us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:10.128701 (+763697us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400059954. stack: 00007f79b693a033 00007f79b6939f30 00007f79b6298534 00007f79bffa48b4 00007f79bffa4849 00007f79b9819471 00007f79b9894f51 00007f79b989399e 00007f79be7d52e9 00007f79b7ebb684 00007f79b7ebb612 00007f79b7ebb541 00007f79b7ebb4bc 00007f79b7eba772 00007f79b7cbe94c 00007f79b7cbdd86
0929 11:37:10.142849 (+ 14148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":970241920}
I20260929 11:37:10.147192 18666 consensus_queue.cc:237] T cb100fbaa5d4434c9b62299d39e52992 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:37:10.422425 18634 consensus_meta.cc:287] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 1.161s user 0.006s sys 0.006s
I20260929 11:37:10.423074 18555 raft_consensus.cc:482] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:10.428862 18690 log.cc:924] Time spent T fdcbe5836ce94afda8b5e9d3a662ca76 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.439s user 0.001s sys 0.000s
W20260929 11:37:10.465716 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 401510us
I20260929 11:37:10.469560 17240 raft_consensus.cc:2454] T 81a2704a8866420f844ab5f310c1e894 P 013a37bea2eb40c0ad4ce8f296176573 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb8e3505668b40219823840c0d8bc3af in term 5.
I20260929 11:37:10.530658 17207 leader_election.cc:302] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters: a7e500c82a21469ab59f66205205a12a
I20260929 11:37:10.531057 17240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac14169d0374d3ea61e619a1488a6f7" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "013a37bea2eb40c0ad4ce8f296176573" is_pre_election: true
I20260929 11:37:10.479043 17465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:10.532104 17207 leader_election.cc:302] T 6520b46bbc094c889371e9c2ff6748bd P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:10.470317 18723 raft_consensus.cc:2781] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260929 11:37:10.478799 18639 raft_consensus.cc:2781] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260929 11:37:10.460282 18660 raft_consensus.cc:686] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [term 5 LEADER]: Becoming Leader. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:10.478412 18443 leader_election.cc:288] T 5ac14169d0374d3ea61e619a1488a6f7 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:10.428992 18662 leader_election.cc:288] T c2fa1c2d5ef24a278619dbf6b3a135ab P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:10.519922 17318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "013a37bea2eb40c0ad4ce8f296176573" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:10.554843 17318 raft_consensus.cc:3037] T af251f3277b7413d8197acd312513289 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:10.520617 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c38ca223cc4337b527ebd9abd29cd5" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
I20260929 11:37:10.486474 18016 raft_consensus.cc:729] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb8e3505668b40219823840c0d8bc3af, State: Running, Role: LEADER
I20260929 11:37:10.533290 17207 leader_election.cc:302] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573, 26cd298fcaa34c9f93d8793e64f0e863; no voters:
I20260929 11:37:10.430178 18621 consensus_queue.cc:260] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:10.557341 17317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af251f3277b7413d8197acd312513289" candidate_uuid: "26cd298fcaa34c9f93d8793e64f0e863" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:37:10.564373 18730 log.cc:924] Time spent T 00000000000000000000000000000000 P 0819e8fa71684f4ca7e117f46b4507bf: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260929 11:37:10.564985 18623 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:10.389262 18693 raft_consensus.cc:504] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
I20260929 11:37:10.479483 18452 raft_consensus.cc:504] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
W20260929 11:37:10.563107 18695 log.cc:924] Time spent T 27f6e0507d9c4264842d9efd8606b256 P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260929 11:37:10.146785 17316 rpcz_store.cc:276] 0929 11:37:08.493049 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:08.497848 (+ 4799us) service_pool.cc:227] Handling call
0929 11:37:08.544643 (+ 46795us) raft_consensus.cc:1457] Updating replica for 0 ops
0929 11:37:08.563678 (+ 19035us) raft_consensus.cc:1520] Early marking committed up to index 3
0929 11:37:08.918856 (+355178us) log.cc:842] Serialized 14 byte log entry
0929 11:37:10.126882 (+1208026us) log.cc:842] Serialized 14 byte log entry
0929 11:37:10.130761 (+ 3879us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0929 11:37:10.130822 (+ 61us) raft_consensus.cc:1631] Marking committed up to 3
0929 11:37:10.130870 (+ 48us) raft_consensus.cc:1683] Filling consensus response to leader.
0929 11:37:10.130962 (+ 92us) raft_consensus.cc:1677] UpdateReplicas() finished
0929 11:37:10.131098 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":123310,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":212108,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":39070,"spinlock_wait_cycles":18074880,"thread_start_us":1405473,"threads_started":4,"wal-append.queue_time_us":600301}
I20260929 11:37:10.564105 18733 consensus_queue.cc:1035] T 9d04716ced464bc8b01430636a571cdd P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260929 11:37:10.567122 17207 leader_election.cc:302] T 96828e8ec02b4abe91b7c6328a84d114 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
I20260929 11:37:10.562770 18660 consensus_queue.cc:237] T 81a2704a8866420f844ab5f310c1e894 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:10.539856 18555 raft_consensus.cc:504] T 3c629677b9d54b97a292b8e5388288eb P bb8e3505668b40219823840c0d8bc3af [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } }
I20260929 11:37:10.533813 18634 raft_consensus.cc:504] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
W20260929 11:37:10.568725 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 257476us
I20260929 11:37:10.570258 18693 leader_election.cc:288] T 930114cd75514fedbbd5bdfe525080f4 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:10.571353 18734 raft_consensus.cc:2726] T 5cfcf62331b042cb8ddc12c582c2d62c P a7e500c82a21469ab59f66205205a12a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260929 11:37:10.572544 18624 leader_election.cc:288] T 0fbfc6a09e844768909a2044d9cb8066 P bb8e3505668b40219823840c0d8bc3af [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
W20260929 11:37:10.572894 18586 consensus_meta.cc:287] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863: Time spent flushing consensus metadata: real 0.941s user 0.008s sys 0.003s
I20260929 11:37:10.509163 18709 raft_consensus.cc:504] T edae75a1c2e04d0d9d7a5e7e26fcdcce P bb8e3505668b40219823840c0d8bc3af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } }
I20260929 11:37:10.573642 18686 leader_election.cc:288] T ac8d7cf3a0d84804ad52464db2fb53ca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599)
I20260929 11:37:10.580693 17207 leader_election.cc:302] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, a7e500c82a21469ab59f66205205a12a
I20260929 11:37:10.539918 18639 raft_consensus.cc:482] T bad8c633e7dd41be8d3c15ae27c52240 P 26cd298fcaa34c9f93d8793e64f0e863 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:37:10.580734 17431 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 178011us
I20260929 11:37:10.541270 18723 raft_consensus.cc:482] T 84d908c031db44039f013807daaa3507 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7e500c82a21469ab59f66205205a12a)
W20260929 11:37:10.584843 17208 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 54745.9us
I20260929 11:37:10.564402 18621 raft_consensus.cc:3037] T 96828e8ec02b4abe91b7c6328a84d114 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:10.586277 17235 raft_consensus.cc:1261] T 35275d14d1b4485fbb03887df828daa2 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:10.530465 18463 consensus_queue.cc:1035] T 1468df1420664db9972432b0042a2488 P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260929 11:37:10.514266 18665 consensus_queue.cc:1035] T 5ac14169d0374d3ea61e619a1488a6f7 P 013a37bea2eb40c0ad4ce8f296176573 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260929 11:37:10.543318 17310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27f6e0507d9c4264842d9efd8606b256" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a"
W20260929 11:37:10.632611 17282 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 98262.9us
W20260929 11:37:10.581230 18732 log.cc:924] Time spent T 4f710cc4eabc43cb9d15d956a7d405ec P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20260929 11:37:10.763772 17389 raft_consensus.cc:2454] T 1df496b2ead6419983ffed1627fb69f9 P bb8e3505668b40219823840c0d8bc3af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7e500c82a21469ab59f66205205a12a in term 3.
I20260929 11:37:10.628139 17464 raft_consensus.cc:1261] T 35275d14d1b4485fbb03887df828daa2 P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Refusing update from remote peer bb8e3505668b40219823840c0d8bc3af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260929 11:37:10.637321 17283 leader_election.cc:302] T 1468df1420664db9972432b0042a2488 P a7e500c82a21469ab59f66205205a12a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7e500c82a21469ab59f66205205a12a, bb8e3505668b40219823840c0d8bc3af; no voters: 26cd298fcaa34c9f93d8793e64f0e863
W20260929 11:37:10.634056 18655 consensus_meta.cc:287] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 1.118s user 0.012s sys 0.000s
I20260929 11:37:10.627336 18706 raft_consensus.cc:482] T ec0779c5ab5f4982ac77456eafc8a9e7 P 013a37bea2eb40c0ad4ce8f296176573 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260929 11:37:10.628870 18697 raft_consensus.cc:2781] T db5a4fd4ad3a4bba9a69926ef6ba204d P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Leader election won for term 4
I20260929 11:37:10.581588 18635 consensus_queue.cc:1046] T 8232a146a4ae4a84b9292eab399fd1cb P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260929 11:37:10.723996 18707 log.cc:924] Time spent T 9c712464fc6c4fb7b3b479dd59774f1a P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.137s user 0.000s sys 0.001s
I20260929 11:37:10.724140 18725 raft_consensus.cc:3037] T 40ff2f2b6de34730a98257133e3882a4 P 013a37bea2eb40c0ad4ce8f296176573 [term 4 FOLLOWER]: Advancing to term 5
I20260929 11:37:10.725309 17314 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48800 (request call id 277) took 1878 ms. Trace:
I20260929 11:37:10.578783 18662 consensus_queue.cc:1035] T 9eaaf8a15b5b4aa3ac199ce1509f3110 P bb8e3505668b40219823840c0d8bc3af [LEADER]: Connected to new peer: Peer: permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
W20260929 11:37:10.729655 18731 log.cc:924] Time spent T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573: Append to log took a long time: real 0.214s user 0.000s sys 0.001s
I20260929 11:37:10.731341 18574 raft_consensus.cc:482] T a1525efb73cb41699f311d353ec85272 P 013a37bea2eb40c0ad4ce8f296176573 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:10.728229 18624 raft_consensus.cc:482] T a69cd2eecec44c94912facf79cbb066e P bb8e3505668b40219823840c0d8bc3af [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260929 11:37:10.732887 18689 log.cc:924] Time spent T 2303ddc899e94157b6c5ad7185a7a9bc P a7e500c82a21469ab59f66205205a12a: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260929 11:37:10.733058 18704 leader_election.cc:288] T 3d5e6ddd0e1143509bc667ce0d157fca P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 26cd298fcaa34c9f93d8793e64f0e863 (127.13.221.196:39599), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
I20260929 11:37:10.666356 18586 raft_consensus.cc:504] T 0c1a5e3d37784c8c866702270fbb2ca6 P 26cd298fcaa34c9f93d8793e64f0e863 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:10.733999 18631 raft_consensus.cc:3037] T 3d5e6ddd0e1143509bc667ce0d157fca P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Advancing to term 4
I20260929 11:37:10.630270 18717 consensus_queue.cc:260] T 95a01f47e3bb47bea991cd4475dfb89f P 013a37bea2eb40c0ad4ce8f296176573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } } peers { permanent_uuid: "013a37bea2eb40c0ad4ce8f296176573" member_type: VOTER last_known_addr { host: "127.13.221.193" port: 35361 } } peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } }
I20260929 11:37:10.734633 17316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2fa1c2d5ef24a278619dbf6b3a135ab" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7e500c82a21469ab59f66205205a12a" is_pre_election: true
I20260929 11:37:10.735081 18703 consensus_queue.cc:1046] T dda74a7e6ff64812814139f0aedd4baf P a7e500c82a21469ab59f66205205a12a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260929 11:37:10.643319 18016 consensus_queue.cc:260] T 5cfcf62331b042cb8ddc12c582c2d62c P bb8e3505668b40219823840c0d8bc3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7e500c82a21469ab59f66205205a12a" member_type: VOTER last_known_addr { host: "127.13.221.194" port: 35795 } } peers { permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 } } peers { permanent_uuid: "26cd298fcaa34c9f93d8793e64f0e863" member_type: VOTER last_known_addr { host: "127.13.221.196" port: 39599 } }
W20260929 11:37:10.736580 18679 log.cc:924] Time spent T 75a68f6896d44d2ca026dcb8e903d1c9 P 26cd298fcaa34c9f93d8793e64f0e863: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
I20260929 11:37:10.738950 18634 leader_election.cc:288] T bdf4a53492b14021977a532a11216ba2 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 5 election: Requested vote from peers bb8e3505668b40219823840c0d8bc3af (127.13.221.195:33835), 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361)
I20260929 11:37:10.739579 18735 raft_consensus.cc:482] T 5cfcf62331b042cb8ddc12c582c2d62c P 26cd298fcaa34c9f93d8793e64f0e863 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bb8e3505668b40219823840c0d8bc3af)
I20260929 11:37:10.820057 17464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930114cd75514fedbbd5bdfe525080f4" candidate_uuid: "bb8e3505668b40219823840c0d8bc3af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "26cd298fcaa34c9f93d8793e64f0e863" is_pre_election: true
I20260929 11:37:10.743029 18452 leader_election.cc:288] T af63fc2fec1c4842a27dea066965a988 P 26cd298fcaa34c9f93d8793e64f0e863 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 013a37bea2eb40c0ad4ce8f296176573 (127.13.221.193:35361), a7e500c82a21469ab59f66205205a12a (127.13.221.194:35795)
@ 0x7f79b6000df4 google::LogMessage::SendToLog() at ??:0
@ 0x7f79b60019a0 google::LogMessage::Flush() at ??:0
I20260929 11:37:10.723009 17208 leader_election.cc:302] T bdf4a53492b14021977a532a11216ba2 P 013a37bea2eb40c0ad4ce8f296176573 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 013a37bea2eb40c0ad4ce8f296176573; no voters: 26cd298fcaa34c9f93d8793e64f0e863, bb8e3505668b40219823840c0d8bc3af
@ 0x7f79b6006adb google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f79bffc880e kudu::TestWorkload::Setup() at ??:0
@ 0x345a78 kudu::master::LeaderRebalancerTest::CreateWorkloadTable() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:109
@ 0x342c46 kudu::master::LeaderRebalancerTest_RestartTserver_Test::TestBody() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:?
@ 0x7f79b6b5be90 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f79b6b39a92 testing::Test::Run() at ??:0
@ 0x7f79b6b3ada9 testing::TestInfo::Run() at ??:0
W20260929 11:37:10.718128 17207 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.196:39599, user_credentials={real_user=slave}} blocked reactor thread for 137526us
@ 0x7f79b6b3bd85 testing::TestSuite::Run() at ??:0
@ 0x7f79b6b50875 testing::internal::UnitTestImpl::RunAllTests() at ??:0
@ 0x7f79b6b5cd50 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f79b6b4fe2d testing::UnitTest::Run() at ??:0
W20260929 11:37:10.741693 17237 consensus_meta.cc:287] T 7466b008788c41588274cefe10e78185 P 013a37bea2eb40c0ad4ce8f296176573: Time spent flushing consensus metadata: real 1.306s user 0.011s sys 0.002s
@ 0x36966c RUN_ALL_TESTS() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:?
@ 0x36852d main at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:?
W20260929 11:37:10.770851 17283 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.221.195:33835, user_credentials={real_user=slave}} blocked reactor thread for 133617us
I20260929 11:37:10.883710 18748 consensus_queue.cc:1035] T edae75a1c2e04d0d9d7a5e7e26fcdcce P 26cd298fcaa34c9f93d8793e64f0e863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8e3505668b40219823840c0d8bc3af" member_type: VOTER last_known_addr { host: "127.13.221.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260929 11:37:10.781495 17309 raft_consensus.cc:2454] T 0600a8955396487994f093e8edbd8ac0 P a7e500c82a21469ab59f66205205a12a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26cd298fcaa34c9f93d8793e64f0e863 in term 3.
I20260929 11:37:11.426803 17309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48786 (request call id 293) took 1360 ms. Trace:
@ 0x7f79b3271c87 __libc_start_main at ??:0
I20260929 11:37:11.427157 17309 rpcz_store.cc:276] 0929 11:37:10.066895 (+ 0us) service_pool.cc:170] Inserting onto call queue
0929 11:37:10.075465 (+ 8570us) service_pool.cc:227] Handling call
0929 11:37:11.426736 (+1351271us) inbound_call.cc:173] Queueing success response
Metrics: {}
@ 0x294389 (unknown) at ??:?